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INTRODUCTION 

The  aim  of  this  project  is  to  develop  a  low-cost,  full-size  digital  x-ray  imager  for  mammography, 
which  is  comparable  to  film/screen  in  quality  (spacial  resolution,  contrast,  and  sensitivity). 
Advantages  of  digital  imaging  (ease  of  storage,  transmission  to  distant  locations,  image 
enhancement,  and  computer-aided  diagnosis)  are  widely  recognized. 

Our  mosaic  approach  is  to  break  the  image  into  segments  or  tiles  which  are  individually  imaged 
by  lenses  onto  relatively  small  CCDs  and  then  to  combine  the  small  images,  by  software,  into  the 
larger  full  size  image  (8''xl0'').  Except  for  the  preliminary  development  of  the  :^y  screen 
described  below,  this  project  is  basically  an  engineering  development  which  optimizes  both 
performance  and  low  production  cost. 

Many  experts  expect  that  eventually  flat  panel  imagers  (e.g.  thin  film  transistors)  will  be  the 
technology  of  choice.  However  it  seems  likely  that  the  production  costs  of  flat  panel  imagers 
will  be  very  high  for  some  years,  as  indicated  by  the  projected  prices  of  full-scale  imagers  which 
are  being  introduced  by  several  major  medical  imaging  companies.  Rather  than  aim  our  imager 
development  solely  at  better  performance  (e.g.  higher  resolution  or  sensitivity)  than  competitive 
commercial  imagers,  we  have  concluded  that  a  good  use  of  the  grant  resources  is  to  develop  a 
moderate  performance,  but  much  lower  cost,  digital  imager  to  serve  groups  or  markets  which 
would  not  otherwise  be  able  to  afford  a  digital  imager.  The  introduction  of  new,  lower  cost 
CMOS  detectors  and  other  electronic  devices  have  made  this  plan  practical.  Accordingly  we 
have  redesigned,  and  have  fabricating  the  data  acquisition  electronics  with  the  new 
cost/performance  criteria.  Our  aim  is  to  design  a  functional,  pre-production,  full-size  digital 
imager. 

As  the  project  progressed  a  decision  was  made  to  focus  on  the  low  cost  market  and  to  base  the 
first  generation  design  on  the  CMOS  (rather  than  CCD)  sensors.  One  reason  was  the  successful 
efforts  of  the  first-tier  medical  imaging  companies  to  enter  the  digital  mammography  market 
with  high  performance,  (but  high  cost)  imagers.  Another  is  the  continuous  technical 
improvements  of  commercially  available  CMOS  sensors,  which  now  equal  the  performance  of 
the  more  expensive  CCD  sensors. 

We  had  planned  a  second-generation  imager  which  would  use  an  x-ray  light  value  (XLV).  If  the 
XLV  could  be  successfully  developed  and  manufactured  at  a  low-cost,  it  would  improve 
mammographic  sensitivity  (DQE),  which  could  aid  in  the  acceptance  of  the  low  cost  imager. 
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BODY 


Significance 

The  benefits  relative  to  the  risks  of  x-ray  mammography  for  the  detection  of  breast  cancer  has 
been  thoroughly  documented.  For  each  1%  increase  in  mammographic  use  in  the  USA,  10000  to 
30,000  malignant  breast  tumors  would  be  detected  and  corresponding  number  of  lives  saved. 
Barriers  to  increase  in  mammogram  uses  are: 

•  Cost  and  Convenience.  A  decrease  in  cost  and  increase  in  convenience  would  attract 
more  women  to  screening  programs. 

•  Deficiencies  in  Image  Quality  and  Interpretation.  Image  enhancements  by  digital 
methods  would  decrease  false  negative  and  positive  rates. 

•  Radiation  risk.  A  reduction  in  the  x-ray  dose  per  mammogram  would  improve  the  risk- 
benefit  ratio  and  allow  more  frequent  tests  or  testing  at  earlier  ages. 

Digital  x-ray  images  as  a  replacement  for  film  are  widely  regarded  as  having  excellent  potential 
for  reducing  these  barriers  as  evidenced  by  extensive  research,  development  and  commercial 
efforts  underway.  While  regarded  as  the  technology  of  the  future,  x-ray  digital  imagers  do  not 
fully  live  up  to  this  potential  because,  while  they  offer  excellent  performance,  they  are  costly. 

By  using  a  mosaic-image,  respectively  with  the  possible  addition  of  crystal  light  valve 
technologies,  a  digital  x-ray  imager.  A  low-cost  digital  x-ray  imager  with  acceptable 
performance  can  be  produced.  The  cost  of  the  imager  itself,  including  computer,  is  much  higher 
than  film,  the  system  cost  (cost  per  mammogram)  is  expected  to  be  less  when  staff  time  and 
image  storage/retrieval/transmission  factors  are  taken  into  account.  There  we  believe  that  we  can 
achieve: 

Advantages  of  digital  x-ray  technology  are: 

•  Rapid,  reproducible  image  acquisition 

•  Computer  Aided  Diagnosis  (or  Analysis) 

•  Teleradiography 

•  Image  Enhancement  Options 

•  Convenient  Archiving 

Specific  targets  for  a  low-cost  digital  imager  for  mammography  are: 

•  Rural  Hospitals 

Trained  personnel  for  taking  high  quality  mammogram  and  experienced  radiologist  for 
reading  them  are  not  likely  to  be  available 

•  Developing  Countries 

The  cost  of  a  standard  digital  imager  is  too  high,  as  well  as  the  lack  of  experienced 
personnel. 
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Specific  Aims 

The  general  aim  of  this  project  was  to  develop  a  low-cost,  full-size  x-ray  imager  for 
mammography  which  is  comparable  to  film/screen  in  quality  (special  resolution,  contrast,  and 
sensitivity).  Advantages  of  digital  imaging  (ease  of  storage,  ease  of  tiansmission  to  distance 
locations,  image  enhancement  capabilities,  and  computer-aided  diagnosis)  are  widely 
recognized. 

Specific  aims  are  given  by  the  following  statement  of  work: 

Design  and  fabricate  a  nmmmographic  inager  with  the  following  charteristics: 

•  Active  area  of  8x1 0  inchs 

•  Pixel  size  of  50  microns  or  less 

•  D5mamic  range  of  12-bits 

•  Border  on  one  side  under  3mm 

•  Workstation  with  capacity  of  500x5000  pixel  display  (internal  resolution) 

•  Operation  on  standard  mammographic  x-ray  sources 


Task  Schedule 

The  final  task  schedule  follows: 

Task  1. Build  Prototype  flow  resolution) 

Design,  build  and  test  a  single  segment  of  the  imager. 

This  was  done  in  the  first  year. 

Task  2.  System  Design 

The  complete  system  was  designed  in  the  first  year,  redesigned  in  the  second,  and  further 
modified  in  the  third. 


Task  3  A,B..  Fabricate  and  Evaluate  Small  Area,  XLV  Prototype 
Fabricate  Hi-Resolution  X-ray  Light  Valve  (XLV) 

An  improved  XLV  will  be  made  by  Kent  State  with  the  help  of  new  facilities  at  Sunnybrook. 
It  will  have  a  resolution  over  1 5  Ip/mm  in  an  area  of  80x80  mm  or  larger. 

The  high  resolution  XLV  will  be  characterized  by  Sunnybrook.. 

These  subtasks  were  not  completed  but  prototypes  of  portions  were  made  and  tested 

Task  3C. 

Fabricate  Optical  System 
Fabricate  and  Test  Electronics  Section 
Fabrication  and  Test  of  Workstation  Interface 
All  these  tasks  were  completed. 
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Task  4.Fabricate  and  Test  Fufl  Size  Imager 

A.  Fabricate  Full  Size,  CCD  Array  and  Circuit  Boards 

B.  Fabricate  and  Test  Electronics  Section 

C.  Refinement  of  Image  Processing  Software 
All  these  tasks  v/ere  completed. 


Task  5 .System  Performance  Test 

A.  Test  of  Imager  .  r,  n 

The  imager  wifl  be  tested  at  SUNY  (ECMC)  using  phantoms,  and  also  specimens  fi*om  Roswell 
Park  Cancer  Institute  (RPCI)  if  appropriate.  In  addition  to  resolution  and  noise,  image  distortion 
and  discontinuities  between  segments  will  be  examined.  Not  completed. 

B.  Comparison  with  Film/screen  ,  •  j  u  v 

Standard  x-ray  film/screens  images  will  be  compared  (at  ECMC)  with  those  obtained  by  the 

imager  under  development.  Not  done. 

C.  Clinical  Trial  Planning 

Planning  for  future  clinical  trials  will  be  made  primarily  by  SUNY  (ECMC)  and  the  consultants. 
Not  done. 

Ta.sk  b.Preoaration.  Radiographic  Workstation  Software 

A.  Implementation  of  Standard  Viewing  Software 
Most  of  this  subtask  was  done. 

B.  Verification  of  Image  Quality  Robustness 

Tests  will  be  made  at  SUNY  (ECMC)  to  veri^^  that  the  image  quaHty  is  not  effected  by  improper 
software  sequences.  Not  done. 

C.  Image  Compression  ^  t  j  xi  * 

A  method  of  image  compression  and  storage  will  be  selected  and  implemented  at  InfiMed.  Not 

done. 

D.  Display  Tests 

The  quality  of  the  display  will  be  evaluated  at  InfiMed,  SUNY  (ECMC  and  RPCI).  Not  done. 
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Accomplishments  (by  Task) 

Task  1  Build  Prototype  (low  resolution^ 

Task  1  was  a  preliminary  task  done  during  the  first  year.  It  consisted  of  one,  then  several, 
sections  of  the  array  constructed  with  ofF-the  shelf  lenses,  Kodak  CCDs,  custom  a/d  electronics 
for  the  acquisitiori/transfer  of  the  image  to  a  PC  where  signal  processing  and  analysis  was  done^ 
The  prototype  worked  satisfactorily  but  since  it  was  superceed  by  prototypes  designed  and 
constructed  in  subsequent  tasks,  it  will  not  be  described  here. 

Task  2  System  Design  ,  .  • 

The  basic  design  was  completed  before  the  end  of  the  second  year.  The  design  process 
actually  consisted  of  designing,  fabricating,  testing  several  prototypes,  with  successive 
improvements.  In  the  early  stages  CCD  image  detectors  were  used  but  in  later  stages  these  were 
replaced  by  CMOS  detectors.  Only  the  final  design  is  described  here  and  the  intermediate  stages 

omitted. 

A.  Imager  Hardware 
General 


Fig.  1  Geometry  ofLow-Cost  X-ray  Imager  for  Mammography 


This  interface  used  a  bi-directional  PC  printer  port  interface.  Logic  circuits,  buffers  and  resistors 
convert  logic  control  levels  driven  from  the  printer  port  into  DSP  commport  control  signals. 
Signals  driven  from  the  DSP  are  converted  into  status  signals,  which  can  be  polled  in  software 
by  the  PC.  In  addition,  the  PC  printer  port  provides  the  byte-wide  data  path  into  and  out  of  the 

PC. 


With  this  printer  port  application,  one  can  use  this  I/O  interface  for  host-data  communication, 
boot  loading  (code),  and  debug  operations.  With  proper  buffering  and  software  control,  it  is  also 
possible  to  build  long  and  reliable  links.  The  speed  is  primarily  dependent  on  the  speed  of  the 
host.  When  using  a  PC  as  the  host,  the  speed  is  limited  by  the  PC  I/O  channel  speed. 
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DSP  and  Memory 


Digital  x-ray  mammography  imager  acquires  image  data  by  18  MHz  clock.  In  order  not  to  miss 
any  pixel  data,  DSP  should  read  and  save  it  faster  than  acquiring  speed.  Static  RAM  is  fast 
enough  but  cost  is  too  high  for  a  large  memory  system.  Conventional  Dynamic  RAM  is  cheap 
but  access  time  is  not  appropriate  to  our  system.  DSP  will  use  synchronized  dynamic  random 
access  memory  (SDRAM)  for  system  main  memory.  Functionally,  an  SDRAM  resembles  a 
conventional  DRAM.  It  is  dynamic  and  must  be  refreshed.  However,  the  SDRAM  architecture 
has  improvements  over  standard  DRAMs  such  as  internal  pipe-lining  to  improve  throughput  and 
on-chip  interleaving  to  eliminate  gaps  in  output  data.  The  addition  of  a  clock  signal  allows  fully 
synchronous  operation  with  the  system  clock  which  is  30  MHz  in  our  x-ray  imager.  This 
SDRAM  enables  image  data  acquiring  successful  without  losing  any  pixel.  Figure  1  shows  block 

diagram  for  DSP  and  SDRAM. 


Figure  2.  Block  diagram  for  DSP  and  SDRAM 
Mammography  Machine  Interface  Circuitry 

To  synchronize  the  X-ray  exposure  with  the  image  capturing  time,  an  interface  circuit  is  being  be 
developed.  Signals  originating  at  the  bucky  plate  of  an  existing  ECMC  mammography  machine 
is  used  for  this  synchronization.  The  bucky  begins  movement  before  the  X-rays  begin  and  will 
therefore  signal  the  imager  electronics  to  get  ready  to  capture  an  image.  An  X-ray  detector  will 
also  be  used  to  signal  the  imager  to  capture  an  image  when  the  X-rays  are  on. 
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The  mammographic  unit  was  tested  at  SUNY/BufFalo  for  testing  of  the  new  imager.  The  most 
easily  accessible  were  those  leads  controlling  the  Bucky  grid  assembly.  We  tested  and  recorded 
using  a  storage  oscilloscope  the  electrical  outputs  available  from  the  Contour  unit  and  found  the 
temporal  relationship  between  those  from  pins  #3  and  #9  of  the  Bucky  connector  and  the 
measured  times  of  radiation  emission  from  the  unit.  We  tested  the  temporal  relationship  for  all 
modes  of  radiography,  i.e.  various  mA  settings  for  both  the  large  and  small  grid  operation.  We 
found  consistent  and  reproducible  relationships  based  upon  which  can  be  designed  trigger  pulses 
for  clearing  and  beginning  the  CCD  readout  after  termination  of  x-ray  exposure.  For  pin  #3  the 
x-rays  are  initiated  40  ms  for  the  small  grid  and  25  ms  for  the  large  grid  after  the  beginning  of 
the  rise  of  the  signals  at  this  pin.  For  pin  #9  the  delay  is  longer;  375  ms  to  420  ms  depending  on 
the  specific  parameters  set.  Synchronization  will  be  crucial  to  reduce  dark  current,  fading,  drift, 
and  noise. 

B.  Image  Reconstruction 
Reconstruction  Algorithms  for  imager 


The  image  quality  of  a  digital  mosaic  imager  relies  upon  schemes  for  distortion  correction  and 
stitching.  The  distortion  correction  is  critical  to  obtain  a  high  quality  of  image.  Several  schemes 
were  developed  for  distortion  correction. 

Correction  schemes  for  image  distortion 

Several  approaches  have  been  developed  to  correct  distortions  introduced  by  optical  components 
of  an  imaging  system.  All  the  approaches  are  based  on  the  use  of  a  calibration  pattern  contairiing 
fiducial  markers.  The  schemes  we  have  developed  include  piece-wise  linear  interpolation, 
bilinear  interpolation,  bicubic  spline  interpolation,  Bezier  composite  surface  interpolation, 
bicubic  B-spline  surface  interpolation,  and  polynomial  modeling  approach.  All  schemes  are 
based  on  the  relation  of  corresponding  control  points  between  the  reference  image  and  the 
acquired  image  of  a  calibration  pattern.  It  should  be  noted  that  the  bilinear  interpolation,  bicubic 
spline  interpolation,  and  polynomial  modeling  approach  are  global  correction  schemes,  while  the 
piece-wise  linear  interpolation,  Bezier  composite  surface  interpolation,  bicubic  B-spline  surface 
interpolation  are  local  correction  ones.  Note  that  to  reconstruct  a  full  image  without  losses  of 
detailed  information  such  as  micro-calcifications,  it  is  desirable  to  employ  a  localized  scheme.  A 
comparison  between  a  localized  scheme  and  global  schemes  will  be  presented  in  the  evaluation 
section.  To  calculate  the  correction  coefficients,  we  have  developed  a  new  calibration  pattern 
shown  in  Figure  3  which  is  acquired  using  a  prototype  2x2  imager.  The  intersections  of  grid  are 
used  as  control  points.  We  have  developed  this  calibration  pattern  by  assuming  that  the  distortion 
in  an  acquired  image  will  be  dominated  in  the  edge  area.  Figure  4  shows  a  stitched  image  with 
distortion  correction  using  cubic  spline  surface  interpolation. 

Stitching  Technique 

Stitching  is  based  on  the  extracted  information  from  a  calibration  pattern.  The  basic  idea  is  tha.t  it 
uses  the  extracted  information  from  a  calibration  pattern  as  an  initial  estimation  for  stitching 
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information  which  it  is  fairly  accurate  in  the  range  of  one  pixel.  However,  this  accuracy  is 
variable  depending  on  the  detection  accuracy  of  control  points.  Using  the  initially  estimated 
information,  it  adopts  one  additional  step  such  as  cross-correlation,  to  find  the  most  accurate 
location  for  stitching.  Test  results  for  this  technique  are  described  in  Task  4. 


Figure  3.  Images  of  the  calibration  pattern  as  acquired  by  each  CCD  sensor 


Figure  4.  Mosaic  image  reconstructed  using  the  spline  interpolation  algorithm. 
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Resolution  Consierations 


The  input  pixel  size  is  42  vim.  By  comparison,  the  GE  mammographic  digital  imager  is  100  urn. 
Studies  of  the  effect  of  pixel  size  on  the  interpretation  of  mammograms  indicate  that  100  pm  is 
adequate  for  screening  and  detection  of  microcaicifications  but  50  urn  (or  maybe  smaller)  may 
be  needed  diagnosis  for  (shape  determination).  We  consider  this  resolution  adequate  for 
mammography  and  perhaps  better  than  expected  for  a  low  cost  imager.  It  should  be  noted  that 
cost  minimization,  while  maintaining  adequate  performance,  requires  the  consideration  of 
multiple,  partly  conflicting  factors  such  as  array  size  lens/CCD  costs,  and  signal  acquisition 
complexity/costs.  A  number  of  designs  were  considered  before  deciding  upon  the  one  described 
here. 

To  reduce  production  costs,  a  single  DSP  processes  the  signal  from  a  set  of  9  imagers.  A  block 
diagram  is  shown  in  Fig.  5.  Data  could  instead  have  been  transmitted  via  the  printer  port  to  the 
main  computer  (Pentium  PC)  for  most  of  the  image  correction  and  reconstruction.  Further 
information  is  given  in  the  Task  4  description.  The  main  disadvantage  is  that  the  process  would 
be  much  slower. 

Like  the  Trex  imager,  one  drawback  to  the  imager  we  are  developing  is  size.  It  is  thicker  (4-6") 
than  some  other  digital  imagers  which  are  generally  closer  to  a  film/screen  cassette  in  size. 
There  is  room  underneath  (opposite  the  x-ray  source)  in  standard  mammographic  x-ray  machine 
for  the  imager,  with  modest  modifications. 


Board  Board 


Figure  5  The  PC  and  DSP  connection  through  FireWire™ 
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Lens  Design  and  Fabrication 

A  single  lens  was  custom  designed  as  discussed,  previous  reports.  An  additional  element  was 
added  to  this  lens  to  further  reduce  defocusing  at  the  edges  of  the  images.  Although  this  lens 
proves  to  achieve  the  desired  imaging  constraints,  the  cost  is  very  high  (  $890/lens  for  8  lenses ). 
If  these  lenses  will  be  used  in  the  final  imager,  even  though  the  cost  exceeds  that  of  the  CMOS 
detector  and  analog  electronics  costs  combined. 

The  light  collection  efficiency  of  the  lens  is  an  important  fact  in  determining  the  image  quality, 
specifically  the  image  background  noise.  A  drawback  of  lens  coupling  in  several  is  that  the  light 
transfer  from  the  x-ray  conversion  screen  has  a  relatively  poor  efficiency.  The  two  main  factors 
which  increase  efficiency  are  (1)  use  of  a  small  demagnification  (we  have  chosen  4.4)  and  (2) 
use  of  a  fast,  low  M  lens  (e.g.  1.1).  A  small  demagnification  is  important.  As  discussed  in 
previous  reports,  the  mosaic  approach  allows  a  relatively  small  demagnification  per  lens.  Once 
the  array  size  is  chosen  (6x6),  the  input  screen  size  is  established  (8"xl0''),  and  the  imaging 
sensor  size  (8.4xl0mm)  is  selected,  then  the  demagnification  (4.4)  is  fixed. 

The  other  factor  is  the  lens  frf.  A  large  aperture  with  short  focal  length,  that  is  a  low  f-number 
lens  combined  with  a  wide  angular  field  of  view  is  desired.  However  it  is  difficult  to  make  a  lens 
with  a  low  M  which  still  provides  high  resolution  over  the  full  field.  The  image  at  the  sensor 
must  have  a  resolution  of  better  than  8pm  even  at  the  edges.  Also  it  must  be  physically  small  so 
that  the  lens  can  be  placed  close  together.  No  satisfactory  commercial  lens  was  found,  even  after 
an  extensive  search.  The  closest  available  lens  was  a  fl.3,  1-inch  format  CCTV  type,  but  it 
could  not  focus  over  the  full  field  unless  stopped  down  excessively  (and  it  was  too  large).  Thus 
custom  design  was  necessary. 

Sensitivity  and  Resolution  Requirements 

To  meet  our  goals  that  the  digital  imager  have  an  image  quality  at  least  as  good  as  film,  it  is 
necessary  that  both  the  resolution  and  sensitivity  be  sufficiently  high.  Studies  of  resolution 
requirements  indicate  that  a  resolution  of  50pm  (10  Ip/mm)  is  desirable  but  that  diagnostic 
accuracy  is  not  effected  if  the  resolution  is  reduced  to  100pm  or  150pm  (the  GE  mammographic 
digital  imager  is  100pm).  The  x-ray  resolution  tests  described  above  indicate  that  the  resolution 
of  our  images  approximately  lOlp/mm,  which  is  consistent  with  the  43pm  screen  pixel  size. 
This  easily  meets  our  goal  but  we  plan  further,  more  quantitative,  tests  (modulation  transfer 
function)  with  the  new  lens  to  verify  the  results. 

Sensitivity  for  our  generation  I  imager  is  more  of  a  concern.  Lens  coupling  of  the  light  is 
inefficient  (only  1.5%  with  the  high  performance  lens).  Since  we  estimate  the  red  conversion 
screen  to  produce  about  1000  light  photons  per  x-ray  photon,  there  will  be  about  15  light  photons 
hitting  the  CMOS  sensor.  With  the  current  sensor,  the  noise  level  is  somewhat  higher  than  the 
signal  (from  one  x-ray  phantom),  a  sub-optional  condition.  With  the  improved  sensors,  available 
this  fall,  we  expect  that  the  signal  will  be  slightly  higher  than  the  noise,  which  is  just  adequate. 
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Imager  noise  is  expressed  quantitatively  by  the  detective  quantum  efficiency  (DQE).  The  DQE 
of  film  is  about  0.5  (low  spacial  fi-equencies)  and  the  best  digital  imagers  are  about  0.7  (1  is 

maximum). 

There  is  no  DQE  specification  on  commercial  mammographic  equipment,  but  rather  the 
requirement  that  specific  set  of  features  on  a  mammographic  phantom  can  be  discerned  (see  Fig. 
6)  with  the  radiation  dose  under  a  given  limit.  Preliminary  tests  indicate  that  this  requirement  is 
met,  or  close  to  being  met,  but  much  more  testing  is  needed.  Film  mammograms  have  a  DQE  in 
the  range  of  0.3  to  0.5  (at  0  Ip/mm)  while  the  newest  digital  imagers  are  in  the  range  of  0.5  to 
0.8.  Higher  quality,  lower  noise  images  can  always  be  obtained  by  incre^ing  the  radiation  dose. 
For  many  medical  applications,  such  as  emergency  medicine,  the  higher  dose  is  acceptable. 
However  it  is  not  acceptable,  or  at  least  undesirable,  for  mammographic  screening.  This  is  why 
the  emphasis  is  placed  on  high  sensitivity. 

Task  3  Fabricate  Small  Screen  Prototype 

The  main  part  of  Task  3,  that  of  the  low-cost  imager  fabrication,  is  an  intermediate  step  to  Task  4 
(full  size  imager).  Several  intermediate  sizes  were  constructed  and  tested  but  they  will  not  be 
described  here  since  they  have  no  features  of  interest  which  are  not  described  in  the  Task  4 
imager. 

A  auxiliary  part  of  the  imager  design  was  to  built  and  test  an  x-ray  light  valve  (XLV).  This  was 
done  by  Sunnybrook  (Toronto).  It  was  originally  intended  that  the  XLV  be  a  part  of  the  first 
prototype.  However,  it  was  not  developed  in  time  and  therefore  the  low-cost  design  described  in 
Tasks  4  and  5  were  developed.  These  use  commercial,  off-the-shelf  components  except  for  the 
circuit  boards,  lenses,  and  mechanical  (optical)  mounts.  The  XLV  was  not  fimshed  because 
funding  was  exhausted,  but  significant  progress  was  made,  as  described  here. 
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Sgvcra.1  x-ray  light  valve  (XLV)  designs  have  been  investigated.  The  key  design  parameters  are 
liquid  crystal  type,  which  controls  the  characteristic  curve  of  the  XLV,  and  the  illumination 

method. 

Figure  6  shows  the  cross-section  of  the  first  prototype  XLV.  It  was  a  sandwich  structure 
composed  of  the  following  layers  from  the  top  down;  a  glass  substrate  with  a  transparent, 
conductive,  Indium  Tin  Oxide  (ITO)  coating;  a  ~  100-500  vim  thick  a-Se  layer;  a  1000-5000  u 
thick  polyamide  (PI)  alignment  layer;  a  ~5-15  pm  thick  LC  cell  formed  by  spacers  for  uniform 
separation  between  the  substrates  and  doped  nematic  LC;  and  a  bottom  glass 
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Figure  6  Cross  section  of  twisted  nematic  x-ray  light  valve  built  on  a  transparent  substrate 
substrate  with  a  conductive  ITO  coating  and  PI  alignment  layer.  The  two  main  steps  in  the 
manufacturing  of  the  prototype  XLV  are  the  a-Se  evaporation  and  the  construction  of  an  LC  cell. 

This  approach  has  demonstrated  high  resolution  images  (see  for  example  the  line  pair  phantom 
showing  9  Ip/mm,  Figure  7)  but  does  have  several  problems  including  fixed  pattern  noise 
associated  with  inadequate  production  methods.  However,  this  the  most  fundamental  problem  is 
the  difficulty  in  illumination  and  readout  as  this  approach  requires  access  to  both  sides,  the  first 
side  to  introduce  illumination  and  the  second  side  to  view  the  complete  image. 

In  order  to  address  this  problem  we  investigate  two  other  methods  both  of  which  permit  readout 
and  illumination  from  the  same  direction.  A  design  for  an  XLV  built  on  an  opaque  substrate  is 
shown  in  Figure  8. 
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Figure  7  Image  of  lead  bar  pattern  (9  Ip/mm  on  left,  6.3  Ip/mm  on  right)  using  a  twisted 
nematic  liquid  crystal  light  valve  built  on  a  transparent  substrate 
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Figure  8  Cross  section  of  aluminum  substrate  twisted  nematic  x-ray  light  valve 


Light  from  the  illumination  source  passes  through  the  polarizer  and  liquid  crystal  layer  and  is 
reflected  by  the  selenium  surface.  It  is  then  passed  back  through  the  liquid  crystal  layer  and  the 
same  polarizer. 

Images  were  created  using  this  procedure  and  an  example  is  shown  in  Figure  9. 


10  Ip/mm 


Figure  9  Image  obtained  using  a  twisted  noematic  x-ray  light  valve  with  an  opaque 

(aluminum)  substrate 

Finally,  a  theoretical  investigation  of  the  feasibility  of  a  polymer  dispersed  x-ray  light  valve  was 
performed.  The  potential  advantage  for  this  approach  is  the  simplicity  of  the  illumination 
methods  which  does  not  require  the  use  of  polarizers  and  since  a  mirror  surface  is  not  used  there 
is  no  need  to  have  a  high  quality  diffuse  source.  There  have  been  several  important  papers  on 
polymer  dispersed  optical  light  valves,  although  they  have  not  been  used  as  x-ray  light  valves 
previously. 
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Figure  10  Cross  section  of  polymer  dispersed  liquid  crystal  x-ray  light  valve 
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The  practical  implementations  of  the  liquid  crystal  light  valve  (XLV)  has  previously  been  shown 
to  have  visible  contrast  (see  Fig.  11),  good  resolution  (~11  Ip/mm),  but  still  had  problems 
associated  with  limited  dynamic  range,  imperfections  in  the  image  and  poor  sensitivity  to 
radiation.  It  was  found  that  it  could  only  operate  at  very  small  applied  potentials  (-50-100  V) 
compared  to  the  design  potential  of  1500  V,  due  to  the  high  potential  causing  the  liquid  crystal  to 
modulate  the  readout  light  prior  to  exposure. 


Figure  11;  Image  of  Finger 
Phantom 

XLV  image  of  a  finger  phantom  at 
-100  V  bias. 


Figure  11  Image  of  Finger  Phantom 

Our  program  was  to  identify  the  causes  of  these  problems  and  propose  methods  to  overcome 
them.  We  have  previously  modeled  the  operation  of  the  XLV  and  had  checked  the  proper 
operating  conditions  and  design  parameters  of  the  components.  Thus  when  the  device  was 
constructed  and  did  not  operate  as  expected  there  was  obviously  some  problem,  but  the  cause 
was  unclear.  Either  the  component  values  had  shifted  during  manufacture  or  the  model  was  not 
correct.  Once  the  device  is  completed  then  the  test  procedures  we  used  on  components  are  no 
longer  useful.  Instead,  system  level  testing  is  needed  to  identify  problems. 

The  major  problems  related  to  both  image  imperfections  and  inadequate  sensitivity  were  both 
deemed  to  be  the  low  operating  potential.  Thus  the  problem  is  to  identify  the  reasons  for  limiting 
the  bias  potential  were  a  primary  focus.  It  was  considered  that  there  could  be  two  possible 
reasons  for  the  need  to  operate  at  very  low  biases,  the  first  was  that  the  dark  current  had  been 
inadvertently  increased  in  the  process  of  making  the  XLV  and  the  second  was  that  the  resistance 
of  the  LC  layer  was  higher  than  expected.  Given  that  the  observed  effect  seemed  to  indicate  that 
a  potential  in  excess  of  prediction  was  present  across  the  LC  layer,  the  second  of  the  two 
possibilities  seemed  the  most  likely. 

Testing  this  theory  involved  the  development  of  a  tool  that  would  indicate  potential  division 
across  the  layers  of  the  XLV,  using  the  liquid  crystal  itself  as  a  probe.  The  operation  of  the  tool 
utilizes  the  fact  that  a  cell  operated  in  reflective  mode  shows  a  peak  in  light  intensity  at  some 
voltage  characteristic  of  the  given  liquid  crystal  material,  and  the  intensity  rapidly  diminishes  to 
low  levels  after  the  bias  potential  is  increased  past  this  key  value.  The  test  procedure  is  illustrated 
in  Fig.  12. 
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Micfoscope/Camefa 


Figure  1?,:  XLV  Evaluation  Arrangement 


Light  source  (laser  or  white  incandescent 
light  with  coloured  filter)  passes  through 
polarizer  and  reflects  off  mirror  surface  of 
XLV.  Reflected  light  passes  through 
analyzer  (optical  axis  at  90°  to  polarizer)  to 
the  microscope  and  CCD  camera.  The  blue 
LEDs  are  used  to  clear  the  image  charge 
and  are  not  illuminated  during  x-ray 
exposure  and  read-out. 


light  Source 
(Laser  or  Incandescent 
non-actinlc  readout  light) 


Therefore,  by  observing  the  transmission  of  the  XLV  over  a  range  of  applied  voltage  values,  the 
transmission  intensity  peak  can  be  used  as  an  indicator  of  when  the  XLV  corresponds  to  this 
characteristic  voltage  across  the  liquid  crystal.  The  image  on  the  front  surface  of  the  ^V  is 
viewed  by  a  CCD  camera  attached  to  a  frame  grabber  computer  system.  The  XLV  itself  is 
connected  to  a  function  generator  which  can  produce  linear  voltage  ramps  at  user  defined  values 
of  peak  voltage  value  and  frequency.  The  frame  grabber  acquires  data  during  the  application  of 
the  ramp,  and  transmission  characteristics  can  be  plotted  for  individual  pixels  or  small  sub¬ 
groups  of  pixels. 

Based  on  these  results  we  propose  a  solution  to  our  low  operating  potential  problem  that  should 
permit  high  quality  images  to  be  produced.  It  is  an  approach  that  eliminates  the  effect  of  the 
biasing  field  simply  by  removing  the  biasing  field  before  readout  is  attempted.  This  entails 
applying  a  shoTt  pulse  of  high  voltage  to  the  XLV,  exposing  to  x-rays  while  the  selenium  is 
properly  biased,  and  then  reducing  the  voltage  below  the  characteristic  voltage  of  the  liquid 
crystal  and  then  capturing  the  image  by  reading  out  the  CCD  camera.  A  timing  diagram  for  this 
approach  is  shown  in  Fig.  13.  ^  _ 
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The  second  major  problem  was  limited  dynamic  range  when  operating  in  the  hybrid  field  mode 
to  permit  front  side  illumination  and  readout.  This  was  addressed  by  investigating  a  novel 
readout  scheme  that  uses  the  time  at  which  a  given  pixel  has  a  maximum  intensity.  Namely, 
since  the  x-ray  signal  produces  an  extra  bias  across  the  liquid  crystal,  an  exposed  area  will  peak 
sooner  than  a  shielded  area  since  it  will  require  less  applied  bias  to  reach  its  characteristic 
voltage.  A  timing  diagram  for  this  approach  is  illustrated  in  Fig.  14. 


Figure  14;  Time-dependent  Image 
Acquisition 

Image  data  is  acquired  during  the  ramp  to 
Vpeak.  For  each  pixel  in  the  region  of 
interest  over  the  ramp  time  the  frame  number 
at  which  intensity  is  maximal  is  found  and 
used  to  construct  the  image. 


This  discovery  indicated  that  an  alternate  way  of  obtaining  images  might  be  useful.  For  a  given 
region  of  interest,  obtaining  the  location  in  frame  numbers  of  the  intensity  peak  for  each  pixel  to 
create  the  image.  Since  the  frame  number  is  a  direct  correspondence  to  the  time  at  which  that 
frame  was  taken  and  therefore  to  the  applied  voltage  at  that  Time,  the  frame  number  will  vary 
depending  on  how  much  signal  charge  was  deposited  on  the'area  of  the  XLV  corresponding  to 
that  pixel. 

This  idea  was  tested  using  a  lead  block  covering  half  the  region  of  interest,  thereby  providing  a 
shielded  area  and  exposed  area  for  comparison.  A  computer  program  was  written  which  located 
the  peak  value  for  each  pixel  and  constructed  the  image.  An  example  of  an  image  obtained  using 
this  procedure  is  shown  in  Figure  15. 

Remaining  tasks  involve  determining  the  final  material  parameters  (type  of  liquid  crystal 
material,  thickness  of  liquid  crystal  layer)  of  the  prototype  XLV. 


Figure  15:  Sample  Constructed  Image  of  Edge 

The  following  equalized  image  (approximate  area  0.4  mm^)  was 
taken  using  a  650  nm  laser  as  a  light  source.  Blotches  in  tlie  image 
are  due  to  the  interference  pattern  made  by  the  laser  on  the  surface. 
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Task  4  Fabricate  and  Test  Full  Size  Imager 


The  full  size  imager  was  designed  so  that  both  the  mechanical/optical  and  electrical  sections 
consisted  of  four  identical  parts,  or  quarter  imagers.  The  four  parts  can  be  built  and  tested 
separately,  then  assembled  into  the  full  size  imager  (except  for  the  scintillation  screen  which  is 
full  size).  However,  due  to  funding  limitations,  only  a  quarter  section  was  actually  built  and 
tested. 

A.  DSP  Design  and  Tests 

The  electronics  block  diagram  of  the  3x3  imager  is  shown  in  (Fig.  16).  The  photographs  in  Fig. 
3B  show  the  3x3  sensor  module  and  lens  mounting  plate. 

The  3x3  block  is  a  quarter  of  the  full  imager.  Each  block  is  identical  and  they  are  placed  ne^  to 
each  other,  and  fit,  to  form  the  full  size  imager.  Each  of  the  9  image  sensor  channels  contains  a 
CMOS  sensor,  analog  support  circuitry,  12-bit  A/D  converter,  and  a  16-bit  buffer  for  digital  data 
output.  The  output  buffers  are  connected  to  two  parallel  digital  channels,  which  enter  the  DSP. 
The  M4  programmable  logic  devices  controls  the  timing  generation  and  multiplexing  of  the 
image  data  from  esch  sensor.  The  chosen  pixel  rate  was  1.25MHz  for  each  sensor,  requiring  the 
DSP  to  acquire  25MB/s  (2  bytes  per  pixel,  5  image  sensor  channels).  All  the  image  data  was 
demultiplexed  in  the  DSP  and  read  out  through  the  IEEE1394  interface  to  the  PC  for  viewing 
and  storage.  The  reconstruction  of  the  images  was  done  using  PC  software. 

The  high-speed  DSP  circuits  with  the  128  Mbyte  RAM,  analog  circuits,  CMOS  timing  circuits, 
were  redesigned  (custom  designed)  for  this  imager.  Because  of  the  large  amount  of  data 
handling  capacity  and  the  low  noise  requirement,  this  was  a  difficult  and  time-consuming  task. 
The  result,  however,  was  high  quality  (production  quality)  printed  circuit  boards. 

Along  with  the  board  development  was  the  migration  of  software  previously  done  on  the  PC  to 
processing  on  the  DSP.  Now  the  image  processing,  as  well  as  the  image  acquisition,  is  done  on 
the  DSP. 

A  single  CMOS  sensor  imager  was  also  constructed  and  used  for  all  the  tests  shown  in  Fig.  1  and 
to  obtain  x-ray  images  to  test  feasibility.  The  photograph  on  Fig.  3  A  shows  this  imager:  Note  a 
reflective  mirror  was  used  along  with  the  imager  electronics  mounted  with  the  lens  horizontal  to 
the  object  plane.  This  was  done  to  create  a  thinner  imager  case  and  to  test  the  concept  for 
possible  use  in  a  production  version.  The  x-ray  scintillating  screen  was  placed  on  the  top  of  the 
imager  case  with  the  lens  focused  at  the  object  plane. 

Firewire  ™ Serial  Bus 

The  PC  and  DSP  connection  through  IEEE  1394  (FireWire™) 

This  mammography  system  processes  a  huge  amount  image  data  for  a  single  shot  (about  40 
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Figure  16  Block  diagram  of  3x3  mosaic  imager  including  DSP  and  IEEE  1394  electronics 
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Figure  17A  Photograph  of  mirror  reflective  prototype  imager  used  to  acquire  x-ray  images. 


Figure  17B:  Photographs  of  the  3x3  CMOS  imager  hardware  module  (top  left),  3x3  CMOS 
mosaic  with  lens  mounting  plate  attached  (top  right),  and  side  view  of  3x3  imager  hardware 

module  (bottom). 
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MB/image  when  using  6x6  imager).  Therefore,  a  fast  data  transfer  scheme  is  necessary.  If  the 
PC’s  parallel  port  were  used,  it  would  take  over  40  seconds.  We  chose  the  faster  serial  data 
transfer  method  called  IEEE  1394  or  FireWire”*.  A  current  transfer  speed  for  Firewire™  is  400 
Mbits/sec.  It  takes  one  second  to  transfer  a  whole  image  under  ideal  situation.  Figure  4  shows  a 
block  diagram  of  the  FireWire  connection  between  the  PC  and  DSP  using  two  FireWire™ 
boards.  One  FireWire™  plug-in  board  for  PC  is  the  off-the-  shelve  product  that  can  be  purchased 
by  a  vendor  such  as  Texas  Instuments.  The  other  Firewire^*^  board  was  designed  and  fabricated 
by  Sensor  Plus.  The  board  is  a  production  quality  printed  circuit  board  (5"x7'').  The  board 
supports  TF.EF.  1394  standards  capable  of  transmitting/receiving  data  at  100,  200  and  400 
Mbits/sec.  It  was  fully  tested  and  shown  to  operate  at  the  required  rate. 

A  custom  lens  design  and  manufacture  was  subcontracted  to  J.A.  Optics  (Utica,  NY).  They 
designed  a  7-element  lens,  which,  by  simulation,  had  the  required  properties  {Ml. I,  7pm  spot 
size  over  full  field  at  demagnification  of  4.4  with  an  object  area  of  35  x  25  mm).  Unfortunately, 
It  took  a  long  time  to  manufacture  and  the  testing  with  this  lens  was  not  completed  (due  to  the 
financial  problems  at  Sensor  Plus). 

The  lens  apparently  met  specifications,  and  it  is  unlikely  that  significant  improvement  in 
performance  (e.g.  M  reduction)  can  be  obtained  with  further  development,  at  least  in  a  lens  of 
this  size.  We  have  reached  this  conclusion  by  discussion  with  lens  designers  and  manufacturers. 

The  optical  throughput  of  the  system  with  this  lens  is  about  1.5%.  A  higher  throughput  (lower 
f#)  might  be  obtained  with  a  much  smaller  lens,  and  with  a  much  smaller  image  size,  but  then  the 
number  of  lenses  and  sensors  would  have  to  be  increased  significantly  (e.g.  to  100  or  400)  which 
we  consider  undesirable.  Therefore  we  consider  this  lens  to  being  close  to  the  best  available  for 
this  approach  (generation  I  low  cost  imager). 
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Task  5  System  Performance  Tests 


System  performance  tests  were  made  on  the  digital  imager  quarter  section  and  also  on  various 
intermediate  prototypes. 

A.  Evaluation  of  correction  schemes 

To  evaluate  the  quality  of  each  correction  scheme,  we  have  carried  out  the  quantitative  analysis 
and  visual  analysis  using  three  types  of  features; 

□  Circumscribed  mass 

□  Spiculated  mass 

□  Micro-calcification. 

Some  of  results  in  the  visual  analysis  is  presented.  Refer  to  [spie  ‘98  mi]  for  details.  Note  that 
we  evaluated  one  of  localized  schemes  -  piece-wise  linear  interpolation  and  two  of  global 
schemes  -  cubic  spline  interpolation  and  bilinear  interpolation.  The  evaluation  of  other  schemes 
is  underway.  Results  presented  here  simulate  a  system  where  four  CCD  sensors  are  used  to 
create  the  digital  mosaic.  The  method  is  identical  for  larger  arrays  (e.g.  6x6).  By  simulation  it  is 
meant  that  a  mathematical  model  of  the  individual  imaging  components  was  employed  instead  of 
building  the  system.  The  overlap  area  of  four  tiles  is  where  the  most  severe  distortions  are 
expected  to  occur.  In  order  to  evaluate  the  quality  of  the  reconstructed  features,  each 
mammogram  was  translated  and  placed  in  a  larger  image  such  that  the  feature  of  interest  falls  on 
the  overlap  region  of  all  four  tiles.  The  mammograms  are  centered  in  a  larger  image  using  the 
center  coordinates  of  the  feature  of  interest  as  the  center  point  of  the  larger  image.  The  size  of  the 
large  image  is  1497x969  pixels  and  it  is  the  same  as  that  of  the  calibration  pattern.  Next  four 
overlapping  subsections  of  size  768x512  are  extracted  from  the  large  image.  Note  that  the 
resolution  of  the  CCD’s  used  in  the  imager  is  also  768x512  pixels.  This  will  enable  the 
application  of  the  imager’s  distortion  function  to  the  mammogram  images.  It  should  be  noted 
that  each  sub-image  undergoes  a  slightly  different  transformation.  The  distortion  function  used 
was  based  upon  a  Barrel  Distortion  model.  As  it  can  be  observed  from  the  images  in  Figures  3 
and  4  (previous  task)  this  function  is  suitable  to  approximate  the  imager  optics.  Once  each  sub¬ 
image  is  distorted  using  the  distortion  function  the  three  correction  schemes,  Piece-wise  linear 
approximation.  Bilinear  interpolation  and  Spline  interpolation  were  applied  to  correct  each  sub¬ 
image.  Sections  from  the  corrected  sub-images  that  do  not  belong  to  the  overlap  area  are 
extracted  and  then  placed  together  to  form  the  reconstructed  mosaic.  The  sections  that  do  not  fall 
in  the  overlap  area  were  of  size  729x485  pixels.  Consequently  the  reconstructed  image  is  the 
same  size  as  the  initial  large  mammogram  image. 

In  Figure  18,  a  series  of  images  of  the  areas  with  features  of  interest  are  shown.  These  images 
were  enhanced  using  the  un-sharp  filtering  operation.  As  it  can  be  observed  the  differences 
between  each  reconstruction  scheme  are  better  viewed  under  such  a  transformation.  However, 
this  operation  is  usually  applied  to  images  prior  to  using  a  computerized  analysis  algorithm. 
Therefore  the  effects  of  these  differences  will  reflect  in  the  performance  of  the  computer 
algorithm.  A  simple  edge  enhancement  and  detection  routine  is  applied  to  the  filtered  images. 
Results  from  this  operation  are  shown  in  Figures  19-A,B,  and  C. 
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It  is  clear  the  computer  algorithm’s  performance  differs  significantly  for  each  of  the  images 
analyzed.  When  observing  the  smaller  feature  visually  images,  it  can  be  argued  that  the  piece- 
wise  linear  interpolation  approach  provided  better  results  relatively  even  if  some  artifacts  can  be 
noticed  as  shown  in  Figures  18  and  19.  However,  when  observing  the  calibration  pattern,  the 
cubic  spline  interpolation  provided  the  best  results  as  shown  in  Figure  4.  The  edge  enhancement 
algorithm  was  least  influenced  when  the  images  were  reconstructed  using  the  piece-wise  linear 
scheme.  It  also  can  be  assumed  that  the  artifacts  introduced  are  related  to  the  calibration  pattern 
employed.  A  different  calibration  pattern  will  introduce  different  types  of  artifacts.  In  Figures  19 
and  18  we  can  observe  the  difference  between  the  localized  scheme  and  the  global  schemes^It  is 
observed  that  the  global  schemes  result  in  a  difference  from  the  original  as  compared  with  the 

localized  scheme. 

B.  CMOS  Sensor  Image  Quality  Optimization 

An  evaluation  of  the  W5850  CMOS  image  was  performed  to  demonstrate  its  feasibility  for  x- 
ray  imaging.  The  evaluation  included  determination  of  both  fixed  pattern  and  random  noise 
levels  of  the  sensor,  determination  of  noise  levels  for  various  exposure  lengths,  characteristics  of 
dark  current  vs.  exposure  time,  sensor  linearity,  and  overall  sensor  signal-to-noise  ratio,  SNR. 
Figures  20.1  thru  20.8  show  the  results  of  these  noise  measurements: 

Figures  20.1  and  20.2  show  the  noise  performance  for  both  fixed  patterned  and  random  sources 
with  respect  to  the  pixel  readout  frequency.  From  our  measurements,  the  prototype  imager 
exhibited  better  performance  with  readout  rates  in  the  range  of  2-3MHz.  This  occurs  since  the 
overall  leakage  current  at  each  pixel  increases  as  the  pixel  rate  decreases,  hence  increasing  the 
fixed  patterned  noise.  At  5MHz  the  on-chip  high  frequency  clocking  noise  increased  the  overall 

noise. 

Figures  20.3  and  20.4  show  the  fixed  patterned  noise  and  random  noise  with  respect  to  exposure 
time.  As  expected,  the  noise  levels  rise  with  increasing  exposure  time,  however  at  exposures  of 
2-3  seconds  the  overall  noise  only  decreases  approximately  4-5dB  from  the  sensors  maximum 
SNR,  as  shown  in  figure  20.8.  After  subtracting  the  fixed  patterned  noise  from  the  image,  the 
overall  noise  present  is  significantly  reduced  and  allows  SNR's  in  the  range  of  60dB  for  longer 
exposures  (2-3  seconds)  and  high  pixel  readout  rates  (2-3MHz). 

Figure  20  5  shows  the  overall  average  dark  current  level  with  respect  to  exposure  time.  With  a 
maximum  signal  range  of  2400  ADU's,  this  CMOS  sensor  exhibited  a  range  reduction  by  a 
factor  of  2  (1200  ADU's)  at  an  exposure  time  of  approximately  26  seconds.  At  exposure  times  ot 
2  seconds  as  used  to  acquire  test  images,  the  reduction  of  the  available  signal  range  was  only  5 
percent.  Thus,  the  dark  current  level  did  not  inhibit  the  image  SNR  much. 

All  noise  measurements  during  this  period  were  conducted  at  approximately  25  degrees  C 
temperature.  However,  the  CMOS  sensor  was  also  tested  at  4.4  degrees  C  to  evaluate  the  overall 
SNR  increase  with  temperature  decrease.  The  following  results  were  obtained: 
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Pigi  20. 1 1  -  Sfp^'  ys.f,  I^evg  1^)  4  2  s. 


Fig  20.3  -5’fp,vVS.  ie,/Vj.s=16,/=2.5MHz 


Fig  20.4  -  SpiooR  '’*•  N^vs-16,/"2.5MHz 


Fig'  20.5  ■  Sdark  vs.  /„  A'»vj=16>/=2.5MHz 


Fig'  20,6  ■it^,N.v^=16,/=2.5MHz 


Fig  20.7  -5/V/?  vs./,  yV„,'=16,  4=2  s,  the  noise  value  used  was 
caicuiated  after  subtraction  of  SFPN  from  the  acquired  image. 


Fig'  20.8  SNR  vs.  t„  /V„«=16,/=2.5MHz,  the  noise  value  used 
was  calculated  after  subtraction  of  SFPN  from  the  acquired 
image. 
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Temperature  [degrees  Cl 

RMS  Noise  Floor  f  ADU's] 

SNR  fdB125 1.7634.4 1.266 

25 

1.7 

63 

4.4 

1.2 

66 

The  mmimum  temperature  for  operation  of  the  VV58S0  sensor  is  0  degrees  C  as  specified  by  tte 
manufacturer.  Operation  of  the  sensor  would  need  to  be  close  to  0  degrees  C  for  optimal  SNR 

performance. 


C.  X-Ray  Testing  at  SUNY/Buffalo 

Initially  a  small  imager  was  built  capable  of  12-14  Ip/mm  using  phosphor  technolo^  and  a  fiber 
taper  coupled  to  a  CCD.  With  this  camera  we  were  able  to  image  fine  specks  of  about  100  pm 
size  as  well  as  features  of  various  phantoms,  both  high  and  low  contrast.  We  are  proceeding  to 
use  these  images  to  further  develop  evaluational  software.  To  provide  a  basis  for  comparative 
studies  we  have  developed  methods  to  extract  digital  images  from  a  Fischer  Mammotest 
Stereoscopic  unit  available  to  us  on  the  U/B  Main  St.  Campus  in  the  Women=s  Health  Initiative. 
The  1024x1 024x1 2bit  images  are  transferred  to  a  PC  for  evaluation  at  this  point  with  a 
removable  hard  drive  and  as  compressed  files  on  floppy  media  The  proprietary  file  structure  has 
been  determined  and  we  have  begun  to  evaluate  this  5x5  cm  limited  field  of  view  imager  using 
objective  as  well  as  anthropomoric  phantoms  in  order  be  able  to  get  quantitative  comparisons 
with  any  imagers  developed  during  this  project. 


Phantom  development  ' 

We  have  found  the  commercial  phantoms  not  to  be  completely  satisfactory  in  evaluating  digital 
mammographic  equipment  and  have  begun  to  develop  our  own  proprietary  phantoms  using 
specks  and  very  small  diameter  micro  tubes.  We  expect  some  of  these  phantoms  to  be  usefiil  m 
any  high  resolution  digital  imaging  application. 


Fie  21  Measured  relation  between  gray  level  provided  by  the  CCD  detector  and  the  light 
intensity  which  produced  that  level.  This  curve  is  used  to  linearize  the  CCD  signal  for  various 

quantitative  functional  analyses. 
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Fig.  22  Sample  line  spread  function  data  obtained  with  a  slit  angled  at  approximately  1.5  degrees 
with  respect  to  the  CCD  array.  A  curve  fit  to  the  data  is  also  shown. 

Preliminary  CCD  MTF 


Fig.  23 


Spatial  Frequency  (cydes/mm) 

Presampled  MTF’s  obtained  in  the  vertical  and  horizontal  directions  of  the  CCD 
array. 
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Channel  ~  X-ray  Exposure 

Channel  -  Pin  from  Bucky  Connection 

Exposure  Factors:  40  mA  100  nsec 


Fig.  24  Schematic  of  oscilloscope  output  showing  x-ray  exposure  waveform  in  channel  #1  and 
corresponding  signal  measured  at  pin  #3  of  the-fiucky  connector  in  channel  #2. 


Channel  #1  X-ray  Exposure 
Channel  Wl  Pin  #9  from  Bucky  Connector 
Exposure  Factors:  40  mA  100  ms 
Small  Grid 


Fig.  25  Schematic  of  oscilloscope  output  showing  x-ray  exposure  waveform  m  channel  #1  and 
corresponding  signal  measured  at  pin  #9  of  the  Bucky  connector  in  channel  #2. 
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D.  Acquired  X-ray  Images 


The  first  x-ray  images  were  acquired  using  the  single  CMOS  detector,  lens,  and  standard  Agfa 
MR  detail  phosphor  screen  (green).  The  system  setup  included  a  Bennett  Contour  mammography 
unit,  the  prototype  CMOS  imager,  and  a  Pentium  166MHz  computer  with  an  internal 
TMS320C40  digital  signal  processor  board  for  acquisition  and  image  processing.  A  digital 
mammography  phantom  from  Nuclear  Associates  was  used  as  well  as  a  standard  resolution 
pattern  to  observe  the  characteristics  of  the  imager.  Each  image  was  taken  with  a  fixed  exposure 
of  30kVp  and  exposure  time  of  2  seconds.  The  lens  was  an  off-the-shelf  fl.3,  12.5mm  focal 
length  CCTV  lens.  The  x-ray  images  are  shown  in  Figure  18  and  19  (following  pages). 

A  red  Eu  doped  Y202S  phosphor  screen  was  fabricated  to  improve  the  light  collection  efficiency 
of  the  x-ray  system.  The  screen  consists  of  a  phosphor  coating  with  a  particle  size  of  30- 
40mg/cm2  and  a  Ti02  reflector  layer  all  mounted  to  1mm  thick  bakelite.  This  screen  was  tested 
during  this  year  and  produced  approximately  25%  greater  intensity  as  compared  with  a  Kodak 
standard  high  resolution  gadolinium  oxysulfide  (Agfa  MR  Detail).  The  measured  resolution 
using  an  off-the-shelf  ^0.95  imaging  lens  was  approximately  8  Ip/mm  and  approaches  the 
projected  10  Ip/mm  specified  in  the  screen  design.  Figures  20  and  21  show  the  x-ray  images 
obtained  with  this  new  screen:  _ _ 


Figure  26  -  This  image  shows  the  resolution  obtained  with  a  standard  X-ray  resolution  bar 
pattern  The  numbers  at  the  top  represent  resolution  in  line-pairs  per  mm.  The  resolution 
approaches  the  limit  of  the  detector  at  12  Ip/mm  (  0.0415  mm  line  width  )  since  the  pixel  size  at 

the  image  plane  is  0.043  mm. 
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Ficure  27  -  4  separate  images  acquired  of  a  digital  mammography  phantom.  The  position  of  the 
Som  was  tSed  to  Ler  Hs  foil  area.  There  are  4  large  circular  masses  with  varying  sizes 
Heft  side  of  phantom),  4  clusters  of  structures  representing  microcalcifications  each  cluster 

ties  in  a  star  pattern,  and  4  bar  stntctures  (top  of  Phantom)  at  a— g  « 
dearee  angles  The  microcalcification  structures  range  in  size  as.  540,  320  240,  and  z 
microns,  ifote  that  it  is  difficult  to  extract  visual  information  for  the  200  micron  structures. 
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Figure  28:  X-ray  of  resolution  pattern  using  Eu  doped  Y202S  phosphor  screen  (red).  Numbers 
represent  resolution  in  line  pairs/mm.  Note  that  8  Ip/mm  is  visible. 


Figure  29:  X-ray  image  of  mammography  phantom  with  2  inch  thick  lucite.  There  should  be  two 
five  point  star  patterns  each  containing  6  microcalcification  structures. 
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2x2  Mosaic  Image  Reconstruction  Tests 

As  a  test  of  the  image  reconstruction,  four  optical  images  were  acquired  using  a  2x2  section  of 
the  3x3  imager.  A  single  lens  was  used  and  four  separate  exposures  were  taken  with  the  lens 
moved  to  adjacent  sensors  to  cover  a  2x2  area.  A  single  lens  was  used  since  the  custom  lens  was 

not  available. 

First,  the  calibration  patterns  were  acquired  and  then  images  of  a  standard  bar  resolution  pattern. 
Each  calibration  image  was  corrected  for  lens  and  geometric  distortions  and  then  the  stitching 
boundaries  were  located.  All  the  reconstruction  coefficients  were  then  saved  and  applied  to  the 
real  images  of  the  resolution  pattern.  Figures  21  and  22  show  the  original  four  images  acquired 
before  corrections  and  the  resulting  2x2  corrected  image  respectively. 


Figure  30;  Four  optical  images  of  a  bar  resolution  pattern  acquired  using  a  2x2  section  of  the 
3x3  imager. 
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Task  6  Prepare  Radiographic  Workstation  Software 

The  software  for  viewing  the  complete  image  from  the  digital  x-ray  camera  (Task  6A)  was 
completed.  It  has  standard  features  such  as  zooming,  contrast/brightness  enhansement,  and  file 
storage  (save)  capabilities.  An  example  of  an  image  is  Fig.  31. 

The  remaining  tasks  (6A,  6B,  and  6C)  were  not  completed . 


BUSINESS  FAILURE  OF  SENSOR  PLUS 

Last  fall  Sensor  Plus  lost  several  key  contracts  and  as  a  result  failed  as  a  business.  All  employees 
were  dismissed  in  November  1999.  Several  employees  remained  in  the  ai-ea  as  independent 
contractors  or  associated  with  SUNY/Buffalo  and  therefore  attempts  were  made  to  continue  the 
mammographic  imager  research.  However  little  work  on  the  project  was  done  since  then  because 
all  funds  were  exhausted. 

As  indicated  in  this  report,  we  believe  that  we  have  made  advances  in  this  area  of  digital  imaging 
and  wish  the  project  to  continue  in  some  form.  Attempts  are  being  made  to  transfer  the  project 
(including  all  rights)  to  the  State  University  of  New  York  at  Buffalo  (SUNY/Buffalo),  which  is  a 
subcontractor  and  has  the  resources  to  continue.  Furthermore,  the  Principal  Investigator  of  this 
project  is  a  faculty  member  there.  The  SUNY/Buffalo  administration  has  not,  as  yet,  made  the 
decision  to  accept  the  project  but  is  negotiating.  If  it  continues  there,  it  will  likely  involve  the 
modification  of  the  imager  to  focus  on  the  problems  described  below  in  "Suggestions  for  Future 
Work”  (p.  45). 


REVIEW  OF  COMMERCIAL  DIGITAL  MAMMOGRAPHIC  IMAGE  TECHNOLOGY 

This  project  has  the  aim  of  developing  a  full-size,  low-cost  digital  imager  for  mammography 
which  is  better  than  film/screen.  The  advantages  of  digital  imaging  over  film/screen 
(teleradiography,  image  quality/reproducibility,  easy  storage/availability,  simple  image 
enhancement,  and  computer-aided  diagnosis)  are  well  accepted.  At  the  time  the  proposal  for  this 
project  was  written,  it  was  unclear  whether  commercial  x-ray  imaging  companies  would  develop 
a  full-size  digital  imager  in  the  near  future.  Several  companies  had  tried  but  apparently  had 
abandoned  efforts.  Now,  however,  several  commercial  full-field  imagers  have  now  been 
developed  and  have  received,  or  are  close  to,  FDA  approval.  Technical  information  on  these 
mammographic  imagers  were  reported  at  the  Fifth  International  Digital  Mammography 
Conference  at  Toronto  (June  2000)  and  also  at  the  Fourth  (Neymegan,  June  1998). 
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®  GE  Medical  Systems 

The  GE  Senograhe  200D  was  the  first  fiiMeld  mammographic  imager  to  be  approved  in  the  US 
by  the  FDA  (Feb  2000).  Images  are  also  of  high  quality,  better  than  film/screen.  Thefcageis 
2000x2500  (100  pm)  pixels  and  the  screen  size  is  18x23  cm.  The  output  is  film,  not  computer  or 
CRT  display  screen  (apparently  required  for  FDA  approval).  A  computer-aided  diagnosis 
developed  by  R2  (Image  checkers)  is  an  option.  The  selling  price  is  in  the  $400k  to  $500k  range. 

®  Fischer  Medical  Imaging 

This  device  uses  a  slot  scanner  detector  (24  x  3.2  mm).  Fiber  optic  tapers  to  several  CCD  arrays 
are  used.  Data  is  stitched  to  form  the  final  full  size  image.  The  image  is  4000x5000  pixels  (50 
pm)  and  film  output  is  also  used.  In  this  design  the  detector  is  smaller  but  the  mechanical 
scanning  system  more  complex.  The  x-ray  tube  current  loading  and  curved  receptors 
(compression  plates)  are  a  problem.  It  is  nearing  FDA  approval.  It  is  expected  to  cost  more  than 
the  GE  system. 

•  Trex  Medical  Imaging  (Lorad  and  Beimet  Divisions) 

This  unit  is  based  on  fiber  optic  taper  coupling  to  a  3x4  CCD  (19x25  cm)  array  or  mosaic  with 
40  pm  resolution  (4800x6400  pkels).  The  DQE  is  0.5  (DC)  over  a  wide  exposure  range  and  is 
better  than  film/screen  over  the  entire  range.  The  output  is  a  computer  screen.  Unfortunately  the 
FDA  has  denied  approval  for  this  device. 

•  Cares-Built 

The  Cares-built  Clarity  7000  is  a  general  digital  x-ray  and  not  intended  as  a  mammographic 
imager  but  it  has  an  adequately  high  resolution  (better  than  GE).  It  uses  the  same  technology 
which  is  used  for  our  imager  (segmented  image,  multiple  lenses/CMOS  detectors)  and  as  a 
consequence  is  low  cost.  It  has  not  yet  been  approved  by  the  FDA. 

®  Triexell  (dpiX,  Phillips,  Siemens,  Thomson,  Varian,  Xerox) 

A  consortium  of  companies  are  developing  digital  flat-panel  detectors  for  digital  x-ray  imaging. 
A  general  radiography  imager  (ECR  2000)  was  announced  in  Feb  2000.  It  is  likely  that  this 
group  is  also  working  on  a  mannographic  imager. 


There  is  some  dispute  as  to  whether  the  output  should  be  on  a  computer  display  screen  or  as  film 
(e.g.  Kodak  laser  printer). 
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Other  companies  which  are  developing  digital  x-ray  imagers  are; 


Fein  Focus 

A  German  company  with  a  magnification  feature  282x406mm,  127  pm  pixels,  2:1  uses  a 
thin  film/screen  transistor  (amorphous  se)  technology'.  It  will  be  introduced  in  Germany 

first. 

Fuji  Medical  Systems 

No  information  released  but  they  are  working  on  it. 

Kodak 

Uses  xereographic  method  (laser  scan)  with  film  output. 

Toshiba 

Similar  to  Kodak 


Comment 


We  conclude  that  these  companies  have  developed  a  full  scale  x-ray  imager  which,  The 
relatively  high  cost  of  these  imagers  ($250K  to  $500K)  is  likely  to  be  acceptable  to  larger 
medical  centers  in  US  urban  areas  but  may  be  unacceptable  to  smaUer  hospitals  in  rmal  areas  or 
poorer  countries.  Yet  it  is  the  smaller  hospitals  that  could  benefit  most  by  digital  imaging, 
especially  the  teleradiology  and  coirqjuter  aided  diagnosis  features. 
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Investigator  List 


A.  Sensor  Plus  Inc.  (Prime  Contractor) 

Dr.  Darold  Wobschall,  (Principal  Investigator) 

Project  Manager 
Overall  System  Design 
Design  of  Analog  Electronics 
Scott  Smith 

Design  and  testing  of  DSP  hardware  and  CCD  data  acquisition 
H.Kim 

Design  and  testing  of  DSP  parallel  processor  and  image  transmission  system 
Myeoung  Jeong 

Development  of  camera  connection  software,  including  distortion  and  alignment 
Tom  Cordier 

Circuit  assembly  supervision 
Circuit  board  layout  and  EMI  reduction 
Kevin  Swindell 

DSP  circuit  testing  and  optical  design 

B.  Sunnybrook  (U.  Toronto) 

Dr.  John  Rowlands 
Supervisor  of  XLV  screen  fabrication 
XLV  design  and  testing 

C.  State  University  of  New  York  at  Buffalo 

Dr.  Stephen  Rudin 

Imager  configuration  and  assuring  compatibility  with  existing  x-ray  equipment 
Help  with  optical  design 
Dr.  Daniel  Bednarek 
X-ray  image  testing 
William  Granger 

Graduate  student  assisting  Drs.  Rudin  and  Bednarek 

D.  Consultants 

Dr.  Thomas  Vogelsong  (VP)  (left  Infimed  in  June,  1999) 

Planning  of  workstation  software 
Dr.  Raj  Acharya 

Software  signal  processing  and  image  reconstruction 
J.  Antonelli 

Design  and  fabrication  of  the  lens. 
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KEY  RESEARCH  ACCOMPLISHMENTS 


The  overall  achievement  is  that  a  low-cost  digital  x-ray  imager  was  successfully  designed  and 
fabricated.  The  next  stage  in  bringing  the  device  to  the  production  stage  is  to  transfer  the 
technology  to  a  company  with  the  capacity  to  manufacture,  clinically  test,  and  market  the  device. 

Specific  accomplishments  are: 

o  The  mosaic  or  segmented  imager  method  worked  in  that  a  large,  high-resoiution  x-ray 
image  was  acquired  by  the  use  of  an  array  of  smaller,  lower  resolution  detectors, 
o  CMOS  optical  detectors  were  shown  to  be  effective,  lower-cost  substitutes  for  the  CCD 
detectors 

o  The  software  distortion  compensation  methods  developed  were  shown  effective  and 
allowed  seamless  images  to  be  acquired, 
o  A  custom  high-resolution,  high  light  tliroughput  lens  was  developed 
o  The  x-ray  light  valve  teclmology  was  advanced. 

o  Analog  and  digital  electronics  supporting  the  segmented  imager  were  developed  which 
was  low-noise,  high-speed,  convenient,  and  low-cost. 
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REPORTABLE  OUTCOMES 


A.  Meeting  presentations  (see  appendix) 

1.  Scott  T.  Smith,  Daniel  R.  Bednarek,  Darold  C.  Wobschall,  Myoimgki  Jeong,  Hyunkeun 
Kim,  Stephen  Rudin,  Evaluation  of  a  CMOS  Image  Detector  For  Low  Cost  and  Power  Medical 
X-rayTmaging  Applications,  SPIE  Medical  Imaging,  vol.  3659,  1999. 

2.  Vivek  Swamakar,  Scott  T.  Smith,  Myoungki  Jeong,  Hyunkeun  Kim,  and  Darold  C. 
Wobschall,  Evaluation  of  A  Digital  Mosaic  Mammographic  Imager,  4th  International  Workshop 
on  Digital  Mammography,  June  1998. 

3.  Scott  T.  Smith,  ,  Vivek  Swarnakar,  Myoungki  Jeong,  and  Darold  C.  Wobschall,  Parallel 
hardware  architecture  for  CCD-mosaic  digital  mammography  ,  SPIE  Medical  Imaging,  vol. 
3335,  1998. 

4.  Vivek  Swamakar,  Myoungki  Jeong,  Scott  T.  Smith,  Hyunkeun  Kim,  and  Darold  C. 
Wobschall,  Effect  of  the  reconstruction  technique  on  the  quality  of  digital  mosaic  mammograms, 
SPIE  Medical  Imaging,  vol.  3340,  1998. 

5.  V.  Swamakar,  M.  Jeong,  R.  Wassennan,  E.  Andres,  and  D.  Wobschall,  An  Integrated 
Distortion  Correction  and  Reconstruction  Technique  For  Digital  Mosaic  Mammography,  SPIE 
Medical  Imaging,  vol.  3031,  pp.  673, 1997. 


B.  Funding  bv  NASA 

A  Phase  I  SBIR  research  contract  "A  Portable  X-ray  Imager  for  Teleradiology  Applications'',  PI: 
S.  Smith,  was  funded  by  NASA.  It  involved  the  development  of  a  digital  x-ray  imager  similar  to 
that  shown  in  Fig.  17.  Unfortunately  Phase  II  was  not  funded. 

C.  Support  of  Students 

The  following  graduate  students  at  SUNY  at  Buffalo  were  supported  by  tliis  contract: 

Scott  T.  Smith 
Hyunkeun  Kim 
Myoungki  Jeong 
Thomas  Cordier 
Richard  Wasserman 
Vivek  Swamaker 
William  Granger 
Eugene  Andres 
Pia-Krista  Reippo 
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D.  Prototype  Imager 

The  hardware  (and  software)  for  the  prototype  imager,  as  indicated  by  the  photographs  of  Fig. 
17,  was  fabricated  with  pre-production  quality  standards  and  are  suitable  for  clinical  testing.  The 
prototype  was  transferred  to  SUNY/Bufialo  with  the  expectation  that  it  will  be  used  there. 


CONCLUSIONS 

A  digital  x-ray  imager  of  high  resolution  (40  um)  and  expandable  to  an  arbitrarily  large  size  hss 
been  developed  and  tested.  The  characteristics  have  been  described  in  detail  in  the  body  of  this 
report.  We  have  achieved  our  goal  from  the  engineering  point  of  view  but  it  is  unclear  whether 
the  imager  can  compete  with  others  which  are  commercially  available. 

Five  years  ago,  when  the  proposal  for  this  project  (digital  mammographic  imager  by  optical 
methods)  was  written,  it  was  not  clear  if  commercial  fiill-field  imagers  ivould  be  developed  in  a 
reasonable  time  frame.  As  indicated  by  the  above  review  of  commercial  imagers,  ftey  now  have 
been  developed  and  do  produce  a  high  quality  image,  although  the  cost  of  the  equipment  is  high. 
Therefore  there  is  little  economic  incentive  for  most  U.S.  companies  to  take  the  technology 
developed  here  into  the  production  stage  as  a  full-field  mammographic  digital  imager. 

In  the  opinion  of  the  Principal  Investigator,  there  still  is  a  need  for  a  low-cost,  full-field  imager 
for  use  in  remote  (rural)  areas  or  in  imderdeveloped  countries.  Specifically  the  advantages  of 
digital  imaging  in  these  areas  include  teleradiograpic  capability  and  computer  aided  diagnosis. 
The  technology  developed  here  is  close  to  fulfilling  this  need  but  would  require  that  the  most 
recently  developed  CMOS  detectors  (released  Summer/FaU  of  2000)  be  incorporated  into  the 
design  for  improved  sensitivity’,  and  then  clinical  testing  be  done.  However  we  recognize  that  the 
Cares-built  digital  imager  (Clarity  7000,  see  www.caresbuilt.com),  which  uses  a  similar  optical 
technology  to  that  developed  here,  is  further  along  in  the  development.  It  has  already  in 
production  for  chest  x-ray,  already  has  the  required  high  resolution,  and  is  basically  a  low-cost 
technology.  Therefore  it  is  a  better  candidate  for  a  commercial,  low-cost  mammographic  imager. 


Suggestions  for  Future  Work 

There  are  three  related  areas  for  which  the  technology  developed  here  is  well  suited.  The  first  is 
stereo  (or  tomographic)  imaging  of  the  breast  for  diagnostic  purposes  (in  contrast  to  screening). 
The  stereo  technique  has  been  tested  by  Maidment  and  Albert  (A.  Maidment  and  M.  Albert,  "A 
Clinical  Study  of  Calcifications  Imaged  by  2-D  and  3-D  Digital  Mammography"  ,  Proceeding  of 
Era  of  Hope  Conference  [Atlanta],  June  2000)  among  others,  and  shown  to  allow  the  viewer  to 
distinguish  microcalcifications  from  the  background  structure  and  also  to  allow  the  structure  of 
the  microcalcifications  to  be  seen.  For  this  purpose,  a  high  resolution  (30  to  50  um)  image  is 
desirable.  A  low-noise,  high  resolution  image  also  allows  microcalcifications  to  be  classified  into 
probable  benign/malignant  on  the  basis  of  size  (100  um  threshold),  as  described  by  Fields  (F. 
Fields,  "Analysis  of  the  Influence  of  Pixel  Size  to  Diagnostic  Accuracy"  5***  Inter.  Conf.  on 
Digital  Mammography  [Toronto],  June  2000).  The  somewhat  higher  x-ray  dose  needed  to  obtain 
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a  clear  stereo  image  is  of  little  consequence  since  the  purpose  is  to  avoid  biopsy  rather  than  to 
screen  the  general  population. 

The  digitized  imager  in  its  present  form,  or  better  with  the  updated  CMOS  detectors,  is  well 
suited  for  this  purpose.  The  image  size,  resolution,  digital  processing  capabilities,  and  moderate 
cost  are  close  to  ideal.  The  institute  best  suited  to  carry  out  research  demonstrating  this  is 
SUNY/Buffaio.  A  digital  mammographic  image  group  is  being  established  there  with  an 
affiliation  by  Roswell  Park  Cancer  Institute  (RPCI).  Many  breast  cancers  are  diagnosed  and 
treated  at  RPCI  so  that  the  addition  of  the  stereoscopic  imaging  facility  is  considered  highly 
desirable  from  the  clinical  and  research  perspectives. 

Another  related  device  for  which  this  technology  is  suitable  is  a  portable  digital  x-ray  for 
emergency  medicine  or  field  hospital  use.  Here  the  specific  characteristics  of  low-cost,  light 
weight,  and  ability  to  combine  (stitch)  images  are  important,  when  combined  with  the  general 
digital  imaging  advantages  of  fast  image  acquisition  and  telecommunication  (preferably  by 
satellite,  or  cellphone  if  necessary). 

Still  another  related  technology  is  a  large  display  or  workstation  for  viewing  digital 
mammograms.  The  mosaic  or  stitching  technology  developed  here  can  be  used  for  display  as 
well  as  image  capture.  Multiple  projection  elements  may  be  combined  to  produce  a  bright,  high 
resolution,  seamless  display  similar  to  film  mammogram  viewing  stations  or  lightboxes.  This 
work  also  can  be  done  at  SUNY/Buffalo. 
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Appendix  A  (Reprints  of  Papers) 

Evaliiation  of  a  CMOS  Image  Detector  For  Low  Cost  and  Power 
Medical  X-ray  Imaging  Applications 

Scott  T.  Smith,  Daniel  R.  Bednarek,  Darold  C.  Wobschall,  Myoungki  Jeong, 

Hyunkeun  Kim,  Stephen  Rudin 

(SS,  DW,  MJ,  HK,  Sensor  Plus  Inc.,  4250  Ridge  Lea  Rd.,  Amherst,  NY  14226;  DB,  SR,  Dept,  of 

Radiology,  SUNY  at  Buffalo,  NY  14215) 


ABSTRACT 

Recent  developments  in  CMOS  image  detectors  are  changing  the  way  digital  imaging  is  performed  for  many  applications. 
The  replacement  of  charge  coupled  devices  (CCD’s),  with  CMOS  detectors  is  a  desirable  paradigm  shift  that  will  depend  on 
the  ability  to  match  the  high  performance  characteristics  of  CCD’s.  Digital  X-ray  imaging  applications  (chest  X-ray, 
mammography )  would  benefit  greatly  from  this  shift  because  CMOS  detectors  have  the  following  inherent  characteristics: 

■  Low  operating  power  (5- 1 0  times  lower  than  CCD/processing  electronics ) 

■  Standard  CMOS  manufacturing  process  (CCD  requires  special  manufacturing) 

■  On-chip  integration  of  analog/digital  processing  functions  (difficult  with  CCD) 

■  Low  Cost  (5-10  times  lower  cost  than  CCD) 

The  achievement  of  both  low  cost  and  low  power  is  highly  desirable  for  portable  applications  as  well  as  situations  where 
large,  expensive  X-ray  imaging  machines  are  not  feasible  (small  hospitals  and  clinics,  emergency  medical  vehicles,  remote 
sites  ).  Achieving  this  goal  using  commercially  available  components  would  allow  rapid  development  of  such  digital  X-ray 
systems  as  compared  with  the  development  difficulties  incurred  through  specialized  direct  detectors  and  systems.  The  focus  of 
this  paper  is  to  evaluate  a  CMOS  image  detector  for  medical  X-ray  applications  and  to  demonstrate  the  results  obtained  from 
a  prototype  CMOS  digital  X-ray  camera.  Results  from  the  images  collected  from  this  optically-coupled  camera  are  presented 
for  a  particular  lens.  X-ray  conversion  screen,  and  demagnification  factor.  Further,  an  overview  of  the  overall  power 
consumption  and  cost  of  a  multi-sensor  CMOS  mosaic  compared  to  its  CCD  counterpart  are  also  reported. 

Keywords:  CMOS  image  sensor,  digital  X-ray  imaging,  digital  mammography,  digital  imaging,  medical  imaging,  low  power 
imaging 


1.  INTRODUCTION 

Complementary  metal  oxide  semiconductor  (CMOS)  image  detectors  are  increasingly  replacing  charge-coupled  devices, 
(CCD's),  for  many  applications  requiring  low  power  and  low  cost.  Applications  such  as  digital  photography,  machine  vision, 
and  video  conferencing  all  benefit  from  CMOS  technology  by  allowing  a  single  CMOS  device  to  replace  the  complex  and 
expensive  circuitry  associated  with  CCD  imaging.  However,  CMOS  imaging  technology  has  only  begun  to  present  itself  to 
the  scientific  and  medical  imaging  communities  due  to  performance  limitations.  The  discussion  below  explains  the  differences 
associated  with  CMOS  and  CCD  detectors  and  why  CMOS  detectors  have  been  limited  to  high-illumination  applications. 

CMOS  detectors  differ  considerably  from  CCD's  in  terms  of  the  readout  electronics  onboard  the  sensors.  The  pixel  structure 
within  an  active  pixel  (AP)  CMOS  sensor  leads  to  greater  fixed  pattern  noise  (FPN)  than  a  typical  CCD  sensor.  Also,  the 
random  noise  floor  of  the  pixel  output  circuitry  in  CMOS  sensors  is  usually  higher. 
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Figure  1.1  -  Typical  MOS  capacitor  structure  of  a  CCD  image  sensor.  Shown  are  two  adjacent  pixels,  or  charge  wells  and  the 
outnut  conversion  circuitry.  The  pixels  are  read  out  by  moving  charges  through  adjacent  pixels.  Columns  are  read  in  parallel  and 
each  row  is  shifted  down  to  an  output  buffer  row.  Finally  each  pixel  charge  packet  is  read  out  in  serial  through  a  charge-to-voltage 
converter  and  output  amplifier. 


Figure  1  2  -  Tvpical  pixel  circuitry  for  an  active  pixel  CMOS  sensor.  Each  pixel  contains  several  CMOS  transistors  to  transfer  the 
analog  voltage  level  to  the  output  buffer.  The  voltage  sensed  at  MOS2  holds  until  read_row  is  enabled,  then  it  is  transferred  to  the 
output  through  an  output  amplifier  using  read_column. 

Fi<Jure  1  1  above  shows  the  pixel  readout  structure  for  a  typical  CCD  sensor  while  figure  1.2  shows  the  electronic  pixel 
sti^ucture'for  an  active  pixel  CMOS  sensor.  The  main  difference  between  the  CMOS  and  CCD  pixel  structures  is  the  use  of 
amDlifVin*’  transistors  for  each  pixel  in  the  CMOS  structure.  Since,  several  amplifiers  are  used  to  transfer  the  analog  pixel 
voltage,  variations  due  to  inconsistencies  in  transistor  characteristics  leads  to  greater  FPN.  This  noise  will  be  present 
variations  in  both  individual  pixel  levels  as  well  as  entire  columns  (  appears  as  stripes  in  image  )  [1,2].  Thus,  to  effectively 
use  CMOS  image  detectors  for  applications  requiring  high  SNR,  a  scheme  of  FPN  cancellation  must  be  employed.  A 
cancellation  technique  is  explained  in  a  following  section. 

The  production  techniques  of  CCD's  and  CMOS  sensors  also  varies  such  that  the  CMOS  sensor  may  be  fabricated  using 
standard  CMOS  1C  techniques  whereas  CCD's  require  special  foundries.  This  leads  to  low  cost  CMOS  sensors  that  may 
contain  a  mixture  of  on-chip  processing  circuitry  minimizing  external  circuitiT-  Since  CMOS  sensors  use  standard  circuitry 
they  are  inherently  low  power  devices  making  portable  imaging  systems  much  more  feasible.  The  remaining  sections  of  this 
paper  present  the  results  of  a  particular  CMOS  sensor  in  terms  of  feasibility  for  low  power  and  low  cost  X-ray  imaging 
applications  with  discussions  of  FPN  cancellation  and  sensor  characteristics. 
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2.  CMOS  SENSOR  CHARACTERISTICS 


2.1  VV5850  CMOS  Image  Detector 

Characteristics  essential  for  high  resolution,  low-light  imaging  include  large  pixel  size,  high  dynamic  range,  high  quantum 
efficiency  and  high  pixel  density.  The  combination  of  large  pixel  size  and  high  pixel  density  on  a  CMOS  sensor  will  allow 
more  efficient  light  gathering  since  the  demagnification  factor  from  object  to  image  plane  will  be  reduced.  Based  on 
aforementioned  criteria,  the  CMOS  sensor  chosen  for  evaluation  was  the  VV5850  monochrome  image  sensor  from  VLSI 
Vision  Lmtd.  A  brief  list  of  specifications  is  shown  in  the  table  beIow[6]: 


Table  1:  VLSI  Vision  Lmtd.  W5850  Monochrome  CMOS  Image  Sensor 


Re'ioiution 

800  X  1000 

Pixels 

Dynamic  Ranee 

66 

dB 

Max  Pixel  Readout  Frequency  ( for  66dB  ) 

5 

MHz 

Pixel  Oiitout  Buffer 

1 

- - - - — ^ — - - 

Pixel  Dimensions 

10.8  X  10.8 

urn 

Quantum  Efficiency  (  500“800nm  ) 

40-50 

% 

Operating  Power 

125 

mW 

Pixel  Fill  Factor 

25 

% 

Aporoximate  Cost  (  US  $  ) 

100 

$ 

2.2  Discussion  of  Noise  and  Dynamic  Range 

CMOS  Detector  Signal-to-Noise  Ratio,  SNRcmos  [5] 


-  S„ 


(1) 


where  SNRcmos  is  the  signal-to-noise  ratio  of  the  CMOS  detector,  S„a.  is  the  maximum  signal  level  a  pixel  may  have  and 
occurs  when  a  charge  well  becomes  saturated,  S„,i„  is  the  average  pixel  level  caused  by  dark  current  leakage,  <SfwoR>  is  the 
noise  floor  of  the  CMOS  detector  as  a  function  of  the  pixel  readout  frequency,^;  and  the  exposure  time,  4-  <Sfwor>  includes 
shot  noise  reset  noise,  dark  noise,  and  other  on-chip  random  sources.  <S,vw>  is  the  fixed  pattern  noise  generated  for  each 
pixel  which  also  depends  on /and  4-  Since  the  FPN  of  a  CMOS  sensor  is  considerably  higher  than  a  CCD,  it  is  important  to 
quantify  this  value,  determine  its  overall  contribution  to  the  SNR,  and  determine  the  maximum  SNR  through  cancellation  of 
this  noise.  The  measurement  of  <S>w>  is  accomplished  by  performing  the  following  operations; 

Acquire  dark  field  (  no  exposure )  images  and  average  over  each  pixel,  /,  J: 


K{U)  = 


I  /  =  1,2,3,..., 

=  1,2,3,...,  M 


(2) 


This  final  average  dark  field  image,  Sp,  represents  an  image  with  Sfloor  significantly  reduced  leaving  mostly  FPN  as  the 
primary  noise  source.  This  allows  measurement  of  the  FPN  as  well  as  the  remaining  combined  noise  sources  as  follows; 


FPN  image  is  approximated  as  an  average  dark  field  image;  _ 

^r-m  * 


(3) 


<5'/,/.oor>  is  approximated  as; 


^FIjOOR 


S-S^ 


(4) 
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where  S  is  a  single  dark  field  image  not  part  of  the  set  of  averaged  dark  field  images  in  S„.  Equations  1-4  represent  the  method 
used  to  quantify  the  noise  sources  of  the  CMOS  sensor  for  this  paper. 


3.  EXPERIMENTAL  RESULTS  OF  X-RAY  CAMERA 


3.1  X-ray  Conversion  and  Optical  System 

The  CMOS  sensor  was  fitted  with  a  standard  1”  format  CCTV  lens  with  a  focal  length  of  12.5  mm  and  f-number  of  1.3.  The 
lens  was  focused  with  a  demagnification  factor  of  approximately  4.0  and  coupled  with  a  standard  high  resolution  gadolmiuni 
oxysulfide  (Agfa  MR  Detail)  phosphor  screen  for  X-ray  conversion.  The  pixel  size  at  the  screen  was  approximately  43um 
with  an  overall  imaging  area  of  43  mm  by  34.4  mm.  This  setup  is  common  among  similar  CCD  based  imagers  which  use  lens- 
coupling[3].  Since  a  standard  lens  was  used,  non-uniform  illumination  occurs  across  the  sensor  array  primarily  at  the  edges. 
To  correct  the  flat  field  response  of  the  optical  system  the  following  calculations  were  applied  to  each  image: 

Intensity  Correction  For  Optical  Non-uniform  Illumination  of  Sensor[8] 


5=-^-IEs.(u) 


n-m 


(5) 

[i  =  1,2,3,... 

(6) 

[y  =  1,2,3,... 

.,m 

f/  =  1,2,3,.. 

.,n 

(7) 

1;  =  1,2,3,.. 

where  5;  is  the  mean  pixel  value  in  the  image  fy  are  the  correction  coefficients,  S’  is  the  final  corrected  image  and  S  is  the 

uncorrected  image  matrix.  The  image  S,  is  an  average  of  8  acquired  images  of  the  same  uniform  intensity  field.  Once  the 
coefficients  Y  are  calculated  they  are  stored  in  the  system  for  future  application.  Each  image  that  is  individually  acquired  is 
corrected  for  non-uniform  intensity  with  these  coefficients.  Also,  the  FPN  and  dark  current  are  subtracted  from  the  images 
before  the  intensity  corrections  are  calculated. 

3.2  X-ray  Imaging  System  Setup 

The  system  setup  included  a  Bennett  Contour  mammography  unit,  the  prototype  CMOS  imager,  and  a  PenPum  166MHz 
computer  with  an  internal  TMS320C40  digital  signal  processor  board  for  acquisition  and  image  processing.  A  digital 
mammography  phantom  from  Nuclear  Asssociates  was  used  as  well  as  a  standard  resolution  pattern  to  observe  the 
characteristics  of  the  imager.  Each  image  was  taken  with  a  fixed  exposure  of  30kVp  and  exposure  time  of  2  seconds. 

3.3  Results  of  Noise  Characteristics 

Based  on  equations  1-4  the  following  noise  measurements  were  obtained  from  the  CMOS  sensor; 
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Mean  Black  Image  LeveUADU]  |  RMS  Fixed  Pattern  Noise  [ADD]  j  RMS  FPNJADU] 
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Figure  3.7  -  SNR  vs./,  N„v*=I6,  4=2  s,  the  noise  value  used  was 
catculated  after  subtraction  of  SFPN  from  the  acquired  image. 


Figure  3.8  -  SNR  vs.  4,  N„„^=16,/=2.5MHz,  the  noise  value  used 
was  calculated  after  subtraction  of  SFPN  from  the  acquired 
image. 


IT*  'll  w/?  v<z  f  N  =16  r  =2  s  the  noise  value  used  was  calculated  after  subtraction  of  SFPN  from  the  acquired  image. 

S:/3  for  both  a.d  with  respec,  .0  .he  pixel  readou.  Moe^From 

cur  measurement.,  the  protocrpe  imager  exhibited  better  performance  with  r'^^oor 

occurs  since  the  overall  leakage  current  at  each  pixel  increases,  hence  increasing  SprN,  as  the  pixel  wa  ts  to  be  read  out.  At 
S”  Te  Lchip  high  ftequency  clocking  increased  die  overall  noise.  Note  that  W«  «  considerably  lower  than  S,„  as 

expected  from  a  CMOS  image  detector. 

Pioiires  3  3  and  3  4  show  Sm  and  Sfioor  with  respect  to  exposure  time.  As  expected  the  noise  levels  nse  with  increasing 
eifosure  time  hLever  at  exposures  of  2-3  seconds  the  overall  noise  only  decreases  approximately  4-5dB  from  the  sensor  s 
^  imiini  <3NR  as  shown  in  figure  3.8.  After  subtracting  Sfpn  from  the  image,  the  overall  noise  present  is  significantly 
redwed  and  allows  SNR’s  in  the'^range  of  60dB  for  longer  exposures  (2-3  seconds)  and  high  pixel  readout  rates  (2-3MHz). 

Finure  3  5  shows  the  overall  average  dark  current  level  with  respect  to  exposure  time.  With  a  maximum  signal  range  of  2400 
S’s  this  CMOS  sensor  exhibited  a  range  reduction  by  a  factor  of  2  (1200  ADU’s)  at  an  exposure  time  of  approximate  y 
26  seconds.  At  exposure  times  of  2  seconds  as  used  to  acquire  test  images,  the  reduction  of  the  available  signal  lange 
only  5  percent.  Thus,  the  dark  current  level  did  not  inhibit  the  image  SNR  considerably. 
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3.4  Acquired  Images 


Figure  3.10  -  Magnified  view  of  the  bottom  right  image  in  figure  3.9.  This  view  shows  the  smallest  microcalcification  structures  in  the 
phantom.  The  structures  on  the  right  represent  200um  structures  and  are  clearly  visible,  however  the  lOOum  structures  on  the  right  arc  not 

all  visible. 


Figure  3.11  -  This  image  shows  the  resolution  obtained  with  a  standard  X-ray  resolution  bar  pattern.  I  he  numbers  at  the  top  represent 
resolution  in  line-pairs  per  mm. 


8 


4.  ESTIMATION  OF  POWER  AND  COST  FOR  MEDICAL  APPICATIONS 


The  total  power  required  for  a  CMOS  based  imager  is  inherently  low  due  to  the  nature  of  CMOS  seimconductor  devices.  The 
in  Jn  sourLs  of  power  consumption  for  the  system  includes  the  CMOS  sensor,  analog-to-digital  (A/D)  converter,  and  timing 
oenerator  The  VV5850  sensor  does  not  contain  an  on-chip  A/D  converter  or  timing  signal  generator  so  external 
devices°were  used  A  12-bit,  5MSPS  (million  samples  per  second)  A/D  converter  was  used  for  quantization  ^d  required 
mW  of  power.  The  timing  signal  generator  was  a  programmable  logic  device  that  required  approximately  of  power 

while  the  VV5850  CMOS  sensor  drew  approximately  125mW.  Additional  support  circuitry  consumed  another  100 
total  measured  power  consumption  of  approximately  750mW  for  the  prototype  imager.  At  this  projected  single  sensor  power 
consumption  a  CMOS  imager  based  on  a  mosaic  array  of  sensors  (3x3)  with  an  effective  imaging  area  of  b  x  10  cm  wou  d 
require  power  as  shown  below: 


Timing  signal  generator 

1 

0.4W 

VV5850  CMOS  image  sensor 

9 

1.125W 

12  bit,  5MSps  A/D  converter 

9 

1.125W 

Other  external  support  circuitry 

9 

0.9W 

Total  power  consumption 

~3.5W 

The  overall  cost  of  the  imager  including  electronics,  lens,  and  phosphor  screen  was  approximately  $500.  At  this  proj^ected 
cost  a  CMOS  imager  based  on  a  3x3  mosaic  would  be  less  than  $5000  US.  The  following  list  summarizes  the  projected  cost 
and  power  consumption  in  comparison  to  a  3x3  mosaic  CCD  based  imager[4]; 

Cost  and  Power  Consumption  Comparison  For  3x3  CMOS  and  CCD  Based  Sensor  Mosaic  Imagers  (3000x2400  pixels) 


Power 

3. 5  Watts 

30Watts 

Cost 

$5000 

$25000 

5.  CONCLUSIONS 

For  digital  radiography  applications  requiring  low  power  and  cost,  CMOS  image  sensors  show  promising  results  terns  of 
feasibUity.  The  resulting  signal-to-noise  ratio  obtained  for  the  particular  CMOS  detector  used  was 

bits!  for  longer  exposures  (2-3  seconds).  The  images  acquired  from  a  digital  mammography  phantom  show  that  CMOS 
sensors  may  be  used  to  obtain  radiographic  information.  Future  work  should  concenfrate  on  increasing  the  light  gat  ermg 
capability  of  the  system  by  optimizing  the  lens  and  phosphor  screen.  Also,  the  application  of  a  micro-lens  array  at  the  CMOS 
sensor  pixels  would  allow  considerably  more  light  to  be  gathered  by  each  pixel  since  the  pixel  fill  factor  would  be  effective  y 

increased. 

Further  reduction  in  cost  and  power  consumption  may  be  achieved  by  integrating  all  necessary  support  circuihy  for  the 
CMOS  sensor  on-chip.  An  A/D  converter  and  specialized  timing  generator  located  on-chip  would  be  a  significant  benefit  for 
any  portable  applications  not  only  in  terms  of  low  power  and  cost  but  minimization  in  terms  of  size  and  complexity  of  the 

imager. 
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Effect  of  the  reconstruction  technique  on  the  quality  of  digital 

mosaic  mammograms 

V.  Swamakar,  M,  Jeong,  S.  Smith  and  H.  Kim  D.  Wobschall 
Sensor  Plus,  Amherst,  NY,  14226 


Digital  mosaic  imaging  techniques  provide  a  cost  effective  means  to  acquiring  high  resolution  images. 
Constrained  mosaic  imaging  techniques  make  use  of  special  purpose  fiducial  patterns  in  order  to  define  a- 
priori  the  relation  between  images  on  each  tile.  This  ’'inter^tile”  relation  is  applied  to  any  images  acquired 
subsequently.  A  simulation  study  was  carried  out  where  a  model  of  the  digital  mosaic  imager  was  used.  By 
doing  so,  it  was  possible  to  compare  the  original  data  to  that  reconstructed  using  different  techniques.  The 
effects  of  these  techniques  on  the  quality  of  the  final  digital  mosaic  image  were  investigated.  The  techniques 
were  applied  towards  reconstructing  mammogram  images.  In  order  to  evaluate  performance  of  the 
approach,  a  set  of  features  of  interest  were  selected  to  measure  image  quality.  Features  that  are  important  to 
visual  perception  include  micro -calcifications  and  other  fine  details  on  the  image,  as  per  a  radiologist’s 
suggestion.  Features  important  to  the  computerized  diagnostic  software  include,  edge  maps  and  other 
common  features  used  in  existing  computerized  mammogram  analysis  approaches.  Results  of  this 
experimental  study  provide  a  better  understanding  of  how  mosaic  reconstruction  approaches  affect  the 
quality  of  the  final  image.  The  study  is  also  helpful  in  defining  the  role  that  features  of  interest,  be  it  from  a 
visual  perception  or  computer  software  point  of  view,  play  towards  selecting  the  image  reconstruction 
scheme  better  suited  for  digital  mosaic  mammography. 

Keywords:  Digital  Mammography,  Image  Quality,  Mosaic  Image  Reconstruction 


L  INTRODUCTION 


Some  of  the  desired  features  for  digital  mammography  systems  are  cost,  high  resolution  and  large  field  of 
acquisition.  Digital  X-ray  images  to  sever  as  successful  replacement  for  film  must  be  aimed  at  satisfying 
these  requirements.  Two  basic  approaches  are  currently  under  investigation  for  digital  mammography.  The 
most  commonly  employed  of  the  two  is  the  one  in  which  conventional  mammogi'ams  are  digitized.  The 
second  approach  is  a  digital  imaging  approach,  wherein  the  mammogram  is  acquired  digitally,  via  the  use  of 
CCD  sensors[2][3].  In  this  approach  CCD  sensors  are  employed  to  observe  an  “imprinf’  of  the  x-ray 
mammogtam  on  a  surface  such  as  Amorphous  Selenium  [1]. 

Existing  approaches  for  digital  mosaic  imaging  can  be  divided  into  two  groups:  (1)  constrained  mosaic 
imaging  (2)  un-constrained  mosaic  imaging.  In  constrained  imaging  approaches,  a-priori  information  such 
as  location  of  custom  designed  fiducial  markers  or  precise  knowledge  of  the  imaging  geometry  is  required. 
Un-constrained  imaging  approaches  use  only  the  infonnation  available  within  each  imaging  tile.  Both 
approaches  introduce  artifacts  in  the  final  reconstructed  image.  Quality  of  the  final  mosaic  image  depends 
on  the  approach  chosen.  For  mammography  applications,  it  is  imperative  that  the  approach  used  introduces 
no  aitifacts  that  may  hinder  the  diagnostic  value  of  the  final  image.  Artifacts  can  be  perceived  visually  or 
detected  by  computerized  diagnosis  schemes.  Images  with  no  visually  perceptible  artifacts  may  contain 
distortions  that  deteriorate  performance  of  a  computerized  diagnostic  software.  Conversely,  images  suitable 
for  computerized  analysis  may  not  have  good  visual  diagnostic  quality.  Therefore  it  is  impoi'tant  to  define 
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parameters  and  thresholds  by  which  the  quality  of  the  final  mosaic  image  can  remain  valuable  to  both  visual 
assessment  and  computerized  diagnosis. 

In  this  work  the  constrained  mosaic  imaging  approach  is  investigated.  Custom  designed  calibration  screens 
were  used  to  achieve  a  high  degree  of  accuracy  in  the  reconstruction.  The  next  section  presents  a  brief 
overview  of  the  digital  mosaic  imager.  Section  3  contains  a  description  of  the  mammogram  selection 
process.  Three  types  of  reconstruction  techniques  were  implemented.  Each  technique  was  applied  towards 
mosaic  image  reconstruction  and  qualitative  analysis  results  are  presented  in  section  4.  Results  obtained  by 
analyzing  a  set  of  mammograms  using  the  different  reconstruction  techniques  are  presented. 


2.  MOSAIC  IMAGING 

An  illustration  of  the  mosaic  imaging  procedure  is  shown  in  Figure  1 .  In  this  example  four  CCD  sensors  are 
placed  in  a  matrix  type  architecture  where  adjacent  sensors  ‘observe’  an  overlapping  field  of  the  image 
plane.  The  digital  mosaic  image  is  reconstructed  by  correcting  any  geometric  distortions  introduced  by  the 
optical  components  and  subsequently  stitching  the  corrected  images.  It  should  be  noted  that  as  there  is 
overlap  between  the  fields  of  view  of  each  CCD  sensor,  the  stitching  step  is  required  to  eliminate 
redundancy.  As  this  work  is  based  upon  using  constrained  mosaic  imaging  approach,  a  caUbration  screen  is 
employed  to  aid  the  correction  of  distortions.  Subsequent  stitching  of  images  is  also  facilitated  due  the  use 
of  the  calibration  screen.  It  can  be  noticed,  as  the  results  section  will  illustrate,  that  the  correction  scheme 
plays  a  critical  role  in  the  final  quality  of  the  mosaic  image. 


Figure  1.  Model  for  the  mosaic  imager. 


2.1  Distortion  Correction 

Several  approaches  have  been  proposed  to  correct  distortions  introduced  by  optical  components  of  an 
imaging  system[4].  One  family  of  such  approaches  is  based  upon  the  use  of  a  calibration  pattern  containing 
fiducial  markers.  The  geometric  relationship  between  the  fiducial  markers  is  loiown  a-priori.  Therefore  an 
inverse  transfonnation  can  be  computed  to  relate  pixel  coordinates  of  the  fiducials  in  the  acquired  image  to 
the  original  pattern.  Another  approach  is  to  develop  a  mathematical  model  of  the  optical  components  and 
use  this  model  to  recover  the  original  pattern.  This  later  approach  has  limitations  when  the  underlying 
optical  components  can  undergo  changes  as  a  function  of  time.  Furthermore  in  the  case  of  mosaic  imaging, 
several  such  components  are  used  and  modeling  each  component  individually  can  be  an  expensive  task.  In 
this  work  the  former  approach  is  used. 


Throughout  the  following,  1  represents  an  image,  the  subscript  index  k  represents  the  CCD  and  the 
superscript  letters  are  r  ;  for  reference  image  (in  the  image  plane),  d  :  for  digitized  image  and  c:  for 

corrected  image.  Let  be  defined  as  a  part  of  the  original  image,  corresponding  to  the  image  area  within 

the  field  of  view  of  the  k*  CCD  in  the  image  plane.  Also  let  //  represent  I[  once  it  is  digitized  by  the 
CCD  imager.  In  earlier  work  an  approach  based  upon  using  piece-wise  linear  approximation  was  described 
in  detail[2].  In  this  work  two  additional  approaches  are  used.  A  new  calibration  patern  has  been  developed 
to  aid  in  improving  the  accuracy  of  the  distortion  correction  stage.  Let  (xf,yf  )  be  the  coordinates  of  a 

fiducial  marker  in  the  digitized  image.  These  markers  can  be  mapped  on  the  reference  pattern  using  the 
a-priori  known  geometric  relation  between  the  fiducials.  Let  (x[,y[)  be  the  coordinates  of  the  associated 
fiducial  in  the  reference  pattern  / ^  .  Given  a  set  oi  such  fiducials  with  their  coordinates  in  the  digitzed 
image  and  their  associated  fiducials  with  coordinate  values  as  mapped  onto  the  reference  image,  a  pair  of 
transformations  and  Ty  can  be  defined  such  that 

x[-TJxf)  andyf=Ty(yf.).  (1) 

Where  the  functions  T,  and  Ty  model  the  distortion  introduced  by  the  imager.  In  this  work  Bilinear 
interpolation  and  Spline  interpolation  are  used  to  model  the  distortion  functions  T,  and  Ty.  Using  the 

interpolating  functions  the  coordinates  of  any  pixel  in  the  digitized  image  //  can  be  associated  to  a  point 

on  the  reference  pattern.  The  images  obtained  by  applying  the  functions  T,  and  Ty.  are  an  approximation 

to  the  original  calibration  pattern  .  In  Figure  2.  the  acquired  images  of  the  calibration  pattern  used  in  this 

work  are  shown.  The  intersection  points  of  each  line  and  the  lines  themselves  are  considered  fiducials.  The 
geometry  of  the  pattern  is  well  defined  so  that  it  is  fairly  straight  forward  to  identify  those  sections  that  are 
overlapping  in  each  image.  Figure  3.  shows  the  reconstructed  image  after  each  of  the  small  images  of  Figure 
2  have  been  corrected  using  spline  interpolation  approach  and  subsequently  stitched  as  described  below. 


Figwre  2.  Images  of  the  calibration  pattern  as  acquire  by  each  CCD  sensor. 


Figure  3.  Mosaic  image  reconstructed  using  the  spline  inteipolation  algorithm. 


It  should  be  noted  that  the  piece-wise  linear  approach  uses  only  four  fiducials  during  a  step,  while  the 
bilinear  and  spline  approaches  are  applicable  to  any  number  of  fiducials.  Thereby  the  piece-wise  linear 
approach  is  a  localized  correction  scheme  while  the  bilinear  and  spline  approaches  are  global  correction 
schemes. 


22  Stitching 

Once  the  digitized  images  have  been  corrected  the  next  step  is  to  stitch  these  to  form  a  mosaic.  One  way  of 
stitching  is  to  use  an  energy  niinirnization  approach  to  find  the  best  matching  coordinates  of  two  images. 
This  approach  requires  additional  interpolation  of  the  pixel  values.  This  methodology  is  difficult  to  be  used 
effectively  when  the  underlying  image  has  undergone  a  non-linear  distortion.  An  alternative  is  to  use  the 
geometry  of  the  calibration  pattern.  It  is  fairly  simple  to  identify  that  section  of  an  image  that  belongs  to  the 
overlap  area.  Therefore  by  exti'acting  the  part  of  the  corrected  image  that  does  not  fall  in  the  overlap  area 
and  placing  these  in  adjacent  tiles  a  stitched  image  can  be  obtained.  This  approach  avoids  additional 
interpolation  of  the  corrected  image.  However  if  adjacent  tile  images  include  effects  of  large  angle  rotation, 
this  simplified  stitching  cannot  be  carried  out  accurately.  In  this  work  this  later  approach  is  chosen  under  the 
assumption  that  there  are  no  large  angle  rotations  in  the  digitized  images.  Then  an  approximation  to  the 

original  image  on  the  image  plane  is  given  by: 


3.  MAMMOGRAM  SELECTION 


Once  a  reconstructed  image  is  available  the  next  step  is  to  evaluate  the  quality  of  the  reconstruction.  This 
issue  is  directly  related  to  the  case  when  acquiring  images  of  mammograms.  In  practice  though,  the  original 
imaije  is  unlcnown  and  only  the  reconstructed  image  is  available.  In  order  to  properly  study  the  effects  of  the 
reconstruction  technique,  the  original  image  is  also  required.  In  this  work  a  series  of  mammograms  were 
digitally  distorted  and  then  stitched  in  order  to  carry  out  qualitative  analysis.  This  process  is  described  in  the 
Section  4. 

Quality  of  the  reconstructed  images  can  evaluated  numerically  and  visually.  Furthermore  this  evaluation  can 
be  carried  out  by  observing  the  entire  image,  or  some  selected  features  of  interest  from  the  image.  A  variety 
of  features  of  interest  can  be  chosen  from  a  mammogram.  After  consulting  with  the  radiological  experts 
involved  it  was  decided  that  for  this  work  thi*ee  types  of  features  would  be  investigated: 


•  Circumscribed  mass 

•  Spiculated  mass 

•  Micro -calcification. 


A  set  of  mammograms  were  selected  from  the  Mammographic  Image  Analysis  Society  database.  This  is  a 
publicly  available  database[7].  The  images  chosen  here  were  all  of  size  1024x1024  and  with  a  200 
micrometers  pixel  size  resolution.  The  types  of  masses  investigated  are  listed  in  the  table  below. 


Feature 

Tissue  Type 

Radius 

Circumscribed  Mass 

Fatty. 

29  pixels 

Spiculated  Mass 

Fatty  Glandular 

53  pixels 

Microcalcification- A . 

Dense 

25  pixels 

Microcalcification-B. 

Dense 

8  pixels. 

Table  L  Types  of  features  of  interest  from  the  mammograms. 


Next  section  contains  analysis  results  for  three  mammograms.  The  radius  of  the  area  surrounding  each 
feature  of  interest  in  these  mammograms  is  also  listed  in  the  table  above.  Areas  with  micro-calcification 
were  from  the  same  image. 


4.  RESULTS 

Results  presented  here  simulate  a  system  where  four  CCD  sensors  are  used  to  create  the  digital  mosaic.  By 
simulation  it  is  understood  that  a  mathematical  model  of  the  individual  imaging  components  was  employed 
instead  of  building  the  system. 

The  overlap  area  of  four  tiles  is  where  the  most  severe  distortions  are  expected  to  occur.  In  order  to  evaluate 
the  quality  of  the  reconstructed  features,  each  mammogram  was  translated  and  placed  in  a  larger  image  such 
that  the  feature  of  interest  falls  on  the  overlap  region  of  all  four  tiles.  So  the  mammograms  are  centered  in  a 
larser  ima^e  using  the  center  coordinates  of  the  feature  of  interest  as  the  center  point  of  the  larger  image. 
The  size  of  the  large  image  is  1497x969  pixels  and  it  is  the  same  as  that  of  the  calibration  pattern.  Next  foui* 
overlapping  subsections  of  size  768x512  are  extracted  from  the  large  image.  Note  that  the  resolution  of  the 
CCD’s  used  in  the  imager  is  also  768x512  pixels.  This  will  enable  the  application  of  the  imagers  distortion 
function  to  the  mammogram  images.  It  should  be  note  that  each  sub-image  undergoes  a  slightly  different 
transformation.  The  distortion  function  used  was  based  upon  a  Barrel  Distortion  model.  As  it  can  be 
observed  from  the  images  in  Figure  2  and  3  this  function  is  suitable  to  approximate  the  imager  optics.  Once 
each  sub-image  is  distorted  using  the  distortion  function  the  three  correction  schemes,  Piece-wise  linear 
approximation.  Bilinear  interpolation  and  Spline  interpolation  were  applied  to  correct  each  sub-image. 
Sections  from  the  corrected  sub-images  that  do  not  belong  to  the  overlap  area  are  extracted  and  then  placed 


together  to  form  the  reconstructed  mosaic.  The  sections  that  do  not  fall  in  the  overlap  area  were  of  size 
729x485  pixels.  Consequently  the  reconstructed  image  is  the  same  size  as  the  initial  large  mammogram 

image. 


4.1  Quantitative  analysis 

One  way  of  examining  the  reconstruction  quality  is  to  compute  numerical  measures  of  disparity  between  the 
original  image  and  the  reconstructed  image.  In  this  work,  three  measures,  namely  the  Mean  Absolute  Error 
(MAE),  the  Mean  Squared  Error  (MSE)  and  the  Cross  Correlation  coefficient  were  used[5].  Given  two 
images  /;  and  I 2  of  some  size  /TrA/the  above  quantities  can  be  defined  below. 


Mean  Absolue  Error  (MAE) ; 

M4£:(/,,/2)  =  1/ A/* 

ij 

Mean  Square  Error  (MSE): 

MSE(I,  =  (ij)  -  4 (iJ)\f 

ij 


Cross  Correlation  Coefficient; 


P  = 


^12 

CTjCTj 


(3) 


(4) 


(5) 


Where  in  equation  (5)  above,  0^,CT2  ate  the  variances  of  the  inrages  /,  and  L  and  is  the  joint  variance 

of  these  images.  The  correlation  coefficient  measures  the  disparity  in  between  the  two  images  gtobally. 
Whereas  the  MAE  and  MSE  estimators  provide  an  average  estimate  of  the  local  behavior  of  the  two  images. 
Initially  all  these  measures  were  computed  using  the  entire  large  mammogram  image.  The  results  are  shown 
in  Table  II.  below.  In  general  it  was  observed  that  the  Bilinear  interpolation  based  method  performed  better 

than  the  other  two. 


Mean  Absolute  Error 


Feature 

Piece-wise  Linear 

Bilinear 

Spline 

Circumscribed  Mass 

1.19 

0.78 

1.09 

Spiculated  Mass 

0.72 

0.49 

0.70 

Microcalcification- A . 

0.67 

0.43 

0.55 

Feature 

Piece-wise  Linear 

Bilinear 

Spline 

Circumscribed  Mass 

31.72 

27.76 

17.15 

Spiculated  Mass 

35.09 

26.88 

29.13 

Microcalcification- A . 

26.25 

19.22 

15.01 

Cross  Correlation  Coefficient 


Feature 

Piece-wise  Linear 

Bilinear 

Spline 

Circumscribed  Mass 

0.9969 

0.9973 

0.9974 

Spiculated  Mass 

0.9945 

0.9958 

0.9954 

Microcalcification-A. 

0.9956 

0.9968 

0.9975 

Table  II.  Quantitative  results  computed  on  the  entire  reconstructed  image. 


Next  these  disparity  measures  were  applied  to  sub-sections  of  the  reconstructed  image  where  the  features  of 
interest  were  located.  Sections  of  size  128x128  were  extracted  from  the  central  part  of  the  reconstructed 
image.  This  is  the  region  where  the  four  tiles  overlap  and  where  the  maximum  distortion  is  expected  to 
occur.  Results  obtained  for  these  images  are  shown  in  the  table  below.  From  these  tables  it  can  be  observed 
that  again  bilinear  interpolation  provided  the  best  and  most  consistent  results. 


Mean  Absolute  Error 


Feature 

Piece-wise  Linear 

Bilinear 

Spline 

Circumscribed  Mass 

1.48 

1.08 

1.16 

Spiculated  Mass 

1.44 

1.09 

1.55 

Microcalcification-  A . 

1.33 

1.05 

1.11 

Microcalcification-B . 

1.36 

1.19 

1.97 

Mean  Squared  Error 


Feature 

Piece-wise  Linear 

Bilinear 

Spline 

Circumscribed  Mass 

4.70 

2.58 

2.97 

Spiculated  Mass 

3.96 

2.37 

2.66 

Microcalcification- A . 

3.55 

2.26 

2.53 

Microcalcification-B . 

3.79 

2.99 

8.85 

Cross  Correlation  Coefficient 


Feature 

Piece- wise  Linear 

Bilinear 

Spline 

Circumscribed  Mass 

0.9989 

0.9994 

0.9993 

Spiculated  Mass 

0.9957 

0.9974 

0.9971 

Microcalcification- A . 

0.9952 

0.9969 

0.9965 

Microcalcification-B , 

0.9923 

0.9939 

0.9821 

Table  III.  Quantitative  results  computed  regions  with  features  of  interest. 


4.2  Visual  Analysis 

Visual  assessment  of  the  image  quality  is  a  subjective  task.  Nevertheless  an  experienced  observer  can 
successfully  identify  any  anomalies  introduced  by  the  reconstruction  procedure.  Visual  evaluation  of  the 
large  images  revealed  that  when  observing  these  images  with  zoom  factors  of  up-to  four  times,  no 
si^ificant  distortions  were  noticed.  In  general,  the  Spline  based  approach  provided  the  most  “visually 
pleasing”  results.  Similar  observation  was  made  when  visually  observing  the  regions  with  features.  In 
Figures  3-A,B,C,D  a  series  of  images  of  the  areas  with  features  of  interest  are  shown.  These  images  were 
enhanced  using  the  unsharp  filtering  operation  [6]. 


Original 


Piece-wise  Linear 


Bilinear 


Spline 


As  it  can  be  observed  the  differences  between  each  reconstruction  scheme  are  better  viewed  under  such  a 
transfonnation-  However,  this  operation  is  usually  applied  to  images  prior  to  using  a  computerized  analysis 
algorithm.  Therefore  the  effects  of  these  differences  will  reflect  in  the  performance  of  the  computer 
algorithm.  A  simple  edge  enhancement  and  detection  routine  is  applied  to  the  filtered  images.  Results  from 
this  operation  are  shown  in  Figures  4-A,B,C  and  D. 


Orisinal 


Piece-mse  Linear 


Bilinear 


Spline 


Original 


Bilinear 


Piece-wise  Linear 


Spline 


Figure  4-D.  Micro-calcification  B. 


As  it  is  clear  the  computer  algorithm’s  performance  is  significantly  different  for  each  of  the  images 
analyzed.  When  observing  the  smaller  feature  images,  visually  it  can  be  argued  that  the  spline  interpolation 
approach  provided  the  most  accurate  results.  However,  the  edge  enhancement  algorithm  was  least 
influenced  when  the  images  were  reconstructed  using  the  piece- wise  linear  scheme.  Some  artifacts  can  be 
noticed  in  the  piece- wise  linear  approach.  It  can  also  be  assumed  that  the  artifacts  introduced  are  related  to 
the  calibration  pattern  employed.  A  different  calibration  pattern  will  introduce  different  types  of  artifacts. 
Regardless  of  the  technique  used  to  reconstruct  the  images,  it  should  be  noted  that  small  details  such  as 
micro-calcifications  were  still  visible  in  the  mosaic  reconstructed  image.  The  overall  ability  to 


CONCLUSIONS 

The  primary  objective  of  this  work  was  to  present  the  effect  different  reconstruction  schemes  have  on  the 
quality  of  the  digital  mosaic  mammograms.  Using  the  constrained  mosaic  imaging  approach  thi*ee  different 
reconstruction  schemes  were  investigated.  Numerical  and  visual  evaluation  of  the  effects  of  these 
approaches  were  presented.  Numerical  evaluation  results  can  support  that  the  bilinear  interpolation  scheme 
provides  the  most  consistent  results  regardless  of  the  type  of  features  present  in  the  mammogram.  Visual 
evaluation  on  the  other  hand  indicated  that  spline  reconstruction  provides  the  most  accurate  reconstruction. 
Lastly,  when  using  a  simple  computer  algorithm  on  regions  with  features  of  interest  it  was  observed  that  the 
piece- wise  linear  approximation  method  influenced  the  performance.  Based  upon  these  observation  it  can 
be  stated  that  as  long  as  visual  or  numerical  quality  evaluation  is  the  criteria,  bilinear  interpolation  will 
provide  the  most  consistent  results.  However,  when  considering  application  of  computer  algorithm  to  these 
images  further  investigation  must  be  carried  out. 
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ABSTRACT 


The  development  of  an  efficient  parallel  hardware  architecture  suitable  for  CCD-mosaic  digital  mammography  has  been 
accomplished.  This  paper  presents  this  architecture  including  both  the  analog  and  digital  portions  of  the  imaging  hardware.  A 
two  dimensional  array  of  CCD  sensors  are  used  to  capture  the  mammographic  image  synchronously  and  simultaneously.  Each 
CCD's  analo<»  signal  is  converted  to  a  12  bits/pixel  digital  value  through  an  array  of  high  speed  analog-to-digital  converters.  A 
parallel  array  ofmesh  connected  TMS320C40  DSP  processors  then  takes  in  the  digital  image  data  simultaneously.  The  DSP's 
are  used  to  precisely  register  the  mosaic  of  individual  images  to  form  the  final  large  format  digital  mammogram.  Also,  tliey 
are  used  to  control  CCD  characteristics  and  parallel  data  transport  to  the  viewing  workstation.  One  master  DSP  is  located  on 
the  workstation's  PCI  bus  which  controls  the  parallel  DSP  array  and  collects  compressed  image  data  through  a  60MB/s  port. 
Since  all  computations  are  performed  in  parallel  using  local  memory  on  each  DSP,  the  overall  acquisition,  image  registration, 
and  transmission  to  display  of  the  final  mammogram  is  performed  in  less  than  30  seconds.  This  allows  the  physician  to 
perfonn  a  preliminary  observation  of  the  patient's  mammogram. 

Keywords:  CCD-mosaic,  parallel  processing,  digital  mammography,  DSP  processors,  digital  imaging,  image  processing 
hardware,  image  registration,  medical  imaging 


1.  INTRODUCTION 

Current  research  in  the  area  of  digital  mammography  addi-esses  feasibility  and  reliability  compared  to  standard  film-based 
approaches.  Specific  areas  of  concern  for  digital  mammography  research  include  the  following!  1,2]: 

■  Physics  of  new  detectors  and  X-ray  conversion  devices 

■  Resolution  and  precision  issues  associated  with  the  sensors  and  acquisition  of  X-ray  Images 

■  Automated  and  assisted  microcalcification  detection  methods  based  on  digital  processing  techniques 
B  Electronic  imaging  methodologies  for  the  capture  of  large  foimat  images 

■  Transmission  and  storage  of  digital  mammograms  for  teleinammography  and  medical  archive  databases 

The  realization  of  efficient  digital  mammography  depends  on  the  integration  of  all  these  areas  into  real  systems.  The 
discussion  of  actual  hardware  systems  for  efficient  acquisition  and  manipulation  of  digital  mammograms  brings  closer  this 
realization.  The  research  presented  in  this  paper  defines  a  mosaic  imaging  hardware  architecture  in  an  attempt  to  create  a 
platform  for  efficient  testing  of  each  aspect  involved  with  the  development  of  digital  mammography. 

Previous  research  for  large  format  imaging  methods  for  mammography  include  the  following!  1  ]: 

■  Slot-scanned 

■  Area-scanned 

■  Scanning  Laser  Stimulated  Luminescence 

■  Large  flat  panel  X-ray  detectors  (  Silicon  and  Selenium  ) 

■  Fiber-coupled  CCD  arrays 


The  imaging  methodology  developed  for  this  research  is  based  on  a  two-dimensional  array  of  charge-coupled  devices 
(CCD’s)  and  lenses  to  achieve  large  format  acquisition[3].  This  technique  is  similar  to  the  area-scan  method  however  no 
mechanical  scanning  is  required  since  the  CCD-mosaic  area  employed  covers  the  entire  image  plane[4].  The  following 
diagram  demonstrates  this  method: 
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Imaging  Plane 


1 -  - ZZi 

/ 

'  V, 

Lens 

j  CCD  1 

[  CCD  1 

[  CCD  ^ 

1  Electronic  board  { 

1 . . . . . ' 

Figure  1:  Lens  coupling  of  image  plane  and  CCD  devices 

This  imaging  method  requires  lens  distortion  correction  and  image  reconstruction  to  form  the  final  continuous  image  [2],  The 
hardware*"  presented  here  is  based  on  the  computational  needs  of  this  imaging  method  however  alternative  reconstruction 
techniques  may  be  implemented  simply  using  high  level  programming  languages. 


2.  SCALEABLE  CCD-MOSAIC  HARDWARE  METHODOLOGY 

Tlie  effectiveness  of  mosaic  imaging  using  multiple  CCD's,  in  terms  of  a  general  architecture  that  may  be  applied  to  any  large 
format  digital  imaging  application,  depends  on  the  ability  to  independently  scale  the  size  of  the  CCD  mosaic  and  the  size  of 
the  parallel  digital  processing  electronics.  Thus,  a  mosaic  imaging  system  should  allow  general  scaleability  regardless  of  the 
imaoin®  speed,  resolution,  and  image  registration  needs.  To  achieve  such  a  generality,  a  connection  methodology  based  on 
three  electronic  layers  will  be  proposed  which  effectively  de-couples  the  CCD  electronic  mosaic  from  the  parallel  processing 
architecturefl  0]. 

The  three  layers  for  this  hardware  architecture  as  shown  in  figure  2  below.  Two  separate  interconnection  networks  (IN)  are 
needed  to  connect  each  hardware  layer.  Layer  1  is  defined  as  the  CCD  layer,  2  is  the  analog  processor  (AP)  layer,  and  3  is  the 
digital  processor  element  (PE)  layer.  Since  the  CCD  layer  output  and  AP  layer  input  are  analog,  an  analog  IN  is  required  for 
their  connection.  The  output  of  the  AP  layer  1  and  the  input  of  the  PE  layer  are  digital  requiring  a  digital  switching  network 
for  connection  Both  analog  and  digital  IN's  may  be  combined  to  connect  independent  hardware  layers  to  form  an  efficient 
hardware  architecture.  To  ensure  the  correct  operation  of  the  connected  layers,  the  bandwidth  of  each  layer  must  satisfy 
equation  1. 


Figure  2:  Modular  mosaic  system:  Layer  l-CCD  electronics,  Layer  2-Analog  processing  electronics,  Layer  3-digitaI  processing  electronics 


N  =  number  of  CCD’s  ( hardware  layer  I ) 

K  =  number  of  analog  processors  ( hardware  layer  2 ) 
p  =  number  of  PE' s  ( hardware  layer  3  ) 

^ccd  ~  Bandwidth  of  CCD' s 

=  bandwidth  of  analog  processors 
Bpf,  =  bandwidth  of  PE  inputs 

(1) 

Following  this  methodology  allows  minimization  of  the  number  of  AP's  and  PE's  needed  for  the  imager  based  on  a  given 
number  of  CCD's  and  the  CCDs'  pixel  rate.  This  minimization  is  important  for  cost  efficiency  as  well  as  physical  size 
reduction.  The  interconnected  layers  allow  any  configuration  of  N  CCD's  with  p  PE's  while  keeping  both  N  and  p  independent 
as  long  as  the  constraint  equation  1  is  satisfied. 

Overall,  this  method  of  de-coupling  the  electronics  of  the  imager  allows  the  designer  to  easily  form  application  specific 
mosaics  by  independently  choosing  the  individual  CCD’s,  the  analog  processing  components,  and  digital  processing  elements. 
For  example,  the  image  reconstruction  algorithms  may  need  to  be  developed  and  tested  on  various  types  of  programmable 
digital  processors  to  achieve  desired  perfonnance  levels.  The  designer  would  be  free  to  attach  the  CCD  and  AP  layers  to  any 
parallel  PE  structure  through  the  digital  IN  without  redesigning  layers  1  and  2. 


3.  PARALLEL  HARDWARE  ARCHITECTURE 


3.1  Discussion  of  Noise 


To  achieve  the  desired  dynamic  range  of  12  bits/pixel  for  the  analog  electronic  layers,  a  noise  model  must  be  analyzed.  A 
brief  representation  of  the  RMS  equivalent  noise  floor  of  the  CCD  and  AP  electronics  is  shown  below[5]: 


CCD  Dynamic  Range 


DRccd  = 


{vj 


(2) 


DRccn  is  the  maximum  dynamic  range  of  the  CCD,  V„ax  is  the  maximum  voltage  a  pixel  may  have  and  occurs  when  a  charge 
well  becomes  saturated,  and  <  K„„j>  is  the  RMS  noise  floor  of  the  CCD.  The  dynamic  range  of  the  CCD  chosen  limits  the 
overall  capability  of  the  imaging  system. 

Analog  Processor  and  Overall  System  Noise 

Noise  sources  in  the  analog  processing  electronic  system  also  contribute  to  the  overall  system  noise.  The  system  noise 
components  are  as  follows: 

1.  Pre-Amplifier  Noise,  Vpre 

2.  Analog  Multiplexer,  ^ mux 

3.  Correlated  Double  Sampler,  Vcds 

4.  A/D  Converter  Noise, 

5.  EMI  (electromagnetic  interference)  from  internal  and  external  sources, 

Not  all  digital  imagers  will  contain  each  of  these  noise  sources,  however  all  should  be  included  for  completeness.  With  these 
added,  the  overall  system  noise  model  becomes: 


(3) 


The  most  difficult  noise  source  to  characterize  and  eliminate  is  which  is  dependent  on  the  physical  layout  of  the  analog 
circuitry  and  the  circuit’s  susceptibility  to  external  and  internal  interference.  Thus,  when  calculating  the  noise  parameters  of 
the  analog  front  end,  the  Vmi  source  is  an  unknown  quantity  that  must  be  estimated  to  ensure  that  a  specific  SNR  will  be 

accomplished. 

Overall,  this  method  of  noise  analysis  allows  a  particular  SNR  to  be  reached  for  any  digital  imager.  This  method  was  used  for 
the  determination  of  the  dynamic  range  capability  of  the  digital  mammography  system. 

3.2  CCD  Sensors 

To  achieve  scientific  quality  imaging,  the  CCD  sensor  chosen  is  of  primary  concern.  Characteristics  of  CCD  s  include  noise 
parameters,  pixel  density  or  resolution,  maximum  pixel  readout  frequency,  number  of  analog  output  buffers,  spectral 
response,  pixel  size,  and  of  course  cost.  The  CCD  chosen  for  the  digital  mammography  device  is  the  Kodak  KAF-0400  full 
frame  image  sensor.  A  brief  list  of  specifications  is  shown  in  the  table  below; 


Table  I:  Kodak  KAF-0400  CCD  Image  Sensor 


Units 

Resolution 

768x512 

Pixels 

Dynamic  Range 

8300 

Horizontal  'Fransport  Frequency  ( each  output )  . 

20 

MHz 

Vertical  Transport  Frequency  ( each  output ) 

500 

kHz 

Output  Buffers 

1 

Pixel  Dimensions 

9x9 

um 

Quantum  Efficiency  (  600-900nm  ) 

30-40  n 

% 

Full-well  Linear  Capacity 

85000 

electrons 

Cost  (US  XGrade  0) 

400 

$ 

The  spectral  response  of  the  KAF-0400  given  in  terms  of  quantum  efficiency  over  a  range  of  wavelengths  is  shown  below  [6]; 

KAF-0400  Spectral  Response 
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Figure  3:  Graph  of  quantum  efficiency  vs.  wavelength  of  the  Kodak  KAF-0400  CCD 


An  overview  of  the  advantages  of  this  CCD  may  be  summarized  as  follows; 

■  Capable  dynamic  range  is  13  bits/pixel 

■  Quantum  efficiency  is  high,  particularly  in  800nm  infrared  range 

■  Pixel  size  is  9um^  which  allows  near  field  focusing  of  the  X-ray  conversion  layer 

■  Pixel  density  is  medium  format,  768x512,  which  allows  efficient  lens  coupling 

■  High  speed  full  frame  readout 

■  Cost  is  relatively  inexpensive 


A  total  of  72  CCD's  are  used  in  a  8x9  array  for  the  full  digital  mammography  device  which  forms  a  maximum  image  size  of 
6144x4608  pixels.  The  lens  demagnification  factor  used  is  5.5:1  such  that  each  CCD  pixel  represents  approximately  50um  at 
the  image  plane.  Thus,  the  total  effective  imaging  area  of  the  imager  is  30.7cm  x  23.0cm,  this  sufficiently  covers  the  full  field 
imaging  area  of  standard  mammography  devices'. 

3.3  Analog  Processing  Hardware 

The  analog  processor  electronics  consist  of  an  array  of  correlated  double  samplers  (CDS's)  and  12  bit  A/D  converters. 
Currently  each  CCD  channel  contains  one  CDS  and  A/D  converter  operating  at  2.5MHz  pixel  rate  for  testing  purposes. 
However,  the  CDS  is  capable  of  operating  at  a  maximum  of  50MHz  with  12  bit  precision  which  will  allow  up  to  20  CCD 
signals  to  be  processed  through  a  single  CDS  by  multiplexing  the  signals.  This  multiplexing  scheme  will  considerably 
increase  efficiency  in  cost,  power,  and  physical  space  for  a  production  digital  mammography  device. 

The  CDS  circuit  effectively  removes  pixel  reset  noise  from  the  CCD's  analog  signal  and  is  of  integral  importance  in  tlie 
analog  processing  chain.  Also,  low  frequency  noise  sources  are  suppressed  with  this  hardware.  The  block  diagram  below 
demonstrates  the  CDS  design: 


Clamp  Sample  Sample/Hold  2 


Figure  4:  Circuit  diagram  of  a  typical  correlated  double  sampler  designed  with  sample  and  hold  amplifiers 


^ ?»/  ysamp/c  j  “  ^CCD  samph  )  ^CCD  y  clamp  )  ^ 

Two  separate  high  speed  sample  and  hold  (S/H)  amplifiers  are  used  to  form  the  CDS  [7].  The  first  S/H  device  samples  the 
reset  level  of  the  cun-ent  pixel  and  the  second  S/H  samples  the  pixel  voltage  level  while  subtracting  the  reset  level.  Equation  4 
above  defines  the  output  of  the  CDS  circuit.  The  pixel  rate  of  the  mosaic  imager  is  2.5MHz  and  the  A/D  converter  chosen  has 
a  maximum  sample  rate  of  5MSPS  [8].  Currently  each  CCD  channel  contains  the  following  circuitry: 
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Figure  5:  Analog  Processor  For  Each  CCD  Channel 


'  Standard  mammography  format  is  24cm  x  1 8cm.  The  CCD-mosaic  is  larger  than  this  format  since  overlap  of  image  data  of  adjacent 
CCD's  must  be  removed  which  will  decrease  the  effective  imaging  area  of  the  device  to  approximately  match  24cm  x  18cm. 


The  calculated  system  noise  floor  referred  to  the  analog  processor  input  is  shown  below  [6,7,8]: 


(5) 

(6) 


{Ky^  =  ^  (Kr,/)  +  ^((^//}  +  +  (^A/D^) 


For  An  Ideal  System 

»  J(l30;/Ff  +2[(5.2//F)'  +(3.8//F)']  +  (20.7/iF)'  =  132/iF/'m 


Maximum  dynamic  range  @  2.5MHz  is: 
F,.  0.850F 


DR, 


' '  fc.) 


132xlO^V 


6439 


DRjhits)  =  log2(r>i?,y,)  w  12.66/te 


(8) 

(9) 


Of  course  the  12  bit  A/D  converter  limits  the  dynamic  range  to  12  bits  in  this  ideal  case.  The  ideal  noise  floor  is  not  easily 
obtained  due  to  external  and  internal  noise  sources  plus  noise  caused  by  temperature  variation  in  the  CCD.  Thus,  the  actual 
intensity  resolution  will  be  approximately  1 1-12  bits  in  the  real  system  with  this  specified  hardware. 


3.4  Parallel  DSP  Hardware 

The  topology  of  the  processing  elements  (PE’s)  determines  the  overall  efficiency  of  the  pai-allel  machine  in  terms  of  its  ability 
to  cairy  out  the  computation  of  specific  parallel  tasks.  Many  parallel  machines  designed  for  image  processing  tasks  employ 
varieties  of  mesh  topologies  since  they  resemble  matrices  whereby  images  are  more  naturally  segmented  among  the  PE's,  The 
mesh  topology  was  chosen  to  provide  versatility  for  general  parallel  image  processing.  To  maximize  efficiency  on  standard 
image  processing  calculations,  DSP  processors  are  incorporated  in  the  design  as  the  basic  PE  module.  The  specific  DSP 
employed  is  the  Texas  Instruments  TMS320C40  parallel  DSP  [9].  The  block  diagram  below  shows  the  general  architecture 
used  to  allow  generic  scaleability  irrespective  of  the  number  of  CCD’s  and  DSP's  in  the  mosaic: 


Figure  6:  Example  of  multiple  processor  architecture  using  DSP's. 


Instruction  Cycle 

33ns 

32  Bit  Floating  Point  Performance 

60  MFLOPS 

I/O  Performance 

384  MB/s 

6  Bi-directional  Communication  Ports 

20  MB/s  each 

Table  2:  Characteristics  of  TMS320C40  DSP  |9] 


Note  that  the  C40  contains  6  bi-directional  communications  ports  which  allow  for  interprocessor  communications  and  digital 
I/O  channels  for  CCD  data  inputs.  Also,  this  DSP  has  a  6  channel  DMA  coprocessor  directly  linked  to  the  COM  ports  to 
allow  data  I/O  without  CPU  intervention.  Four  CCD's  are  connected  to  one  DSP  processor  such  that  the  total  8x9  CCD- 
mosaic  requires  a  total  of  18  DSP  processors  plus  one  master  DSP.  The  following  diagram  shows  the  digital  interconnection 
network  and  CCD  mosaic  interface  designed  for  the  digital  mammography  device: 
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Figure  7  -  Details  of  digital  interconnection  network  between  AP's  and  the  DSP  processor 
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Figure  8  -  Details  of  hardware  architecture  for  DSP  PE. 


To  test  the  performance  of  the  parallel  C40  architecture,  a  dual  processor  configuration  was  used.  The  memory  architecture 
for  each  processor  is  a  dual  local  structure.  That  is,  each  DSP  contains  two  memory  banks  connected  via  two  independent  32 
bit  data  and  address  buses.  The  C40  is  designed  to  perform  two  instructions  per  clock  cycle  on  data  arriving  from  both  of  its 
data  buses,  hence  performance  is  significantly  increased  with  dual  memory  banks.  The  decision  to  avoid  a  global  memory 
bank  accessible  by  each  processor  resulted  from  the  looming  bandwidth  bottleneck  problem  associated  with  N  processors 
connected  to  one  memory.  This  design  also  uses  single  cycle  accessible  SRAM  for  program  instruction  storage  and  highly 
used  data  sections.  This  adds  to  performance  since  wait  states  are  avoided  for  many  data  operations. 

To  test  the  overall  time  required  to  register  the  final  image  from  the  segmented  image  data,  a  method  tor  geometrical  lens 
distortion  correction  and  segment  stitching  was  ported  to  the  C40  architecture  [2].  The  distortion  correction  algorithm 
operates  sequentially  on  each  of  the  four  images  acquired  per  DSP.  The  stitching  of  image  segments  is  perfoiTned  by 
transferring  image  data  from  each  local  DSP  memory  to  a  host  workstation  memory  via  tlie  master  DSP.  We  assume  that 
every  mosaic  image  has  the  same  valid  area  that  excludes  overlapping  areas  (  i.e.,  after  distortion  correction  each  image 
contains  the  same  set  of  reference  points  used  for  stitching )  otherwise  a  more  complicated  stitching  method  is  necessary.  The 
following  results  demonstrate  the  total  time  needed  to  acquire  and  fully  register  the  6000x4500  pixel  mammogram. 


4.  SIMULATED  RESULTS  OF  A  2x2  CCD-MOSAIC  IMAGER 

Digital  mammography  requires  the  following  imaging  constraints  to  ensure  feasibility: 

■  12  bits/pixel  dynamic  range  and  high  light  sensitivity  CCD's 

■  1 8cm  X  24cm  image  plane 

■  50um  resolution  at  the  image  plane 

■  Very  low  geometric  distortion  and  image  registration  errors 

■  Acquisition-to-display  time  less  than  film  X-ray  imagers  ( less  than  l-5minutes) 

■  Simultaneous  and  synchronous  CCD  acquisition  to  avoid  varying  individual  exposure 

Based  on  these  expectations  and  the  methodologies  presented  previously  in  this  work,  a  prototype  imager  and  dual  DSP 
system  was  developed  to  simulate  the  mosaic  imaging  technique.  Since  a  full  mammographic  imager  (6000x4500  pixels) 
would  be  expensive  to  prototype,  a  smaller  imager  and  simulations  are  a  much  more  cost  effective  method  for  proof  of 
operation. 

The  system  design  was  created  following  the  modular  system  method.  The  exposure  time  was  set  to  160ms  and  a  strobed 
lighting  scheme  was  employed  for  illumination.  Most  X-ray-to-light  conversion  techniques  require  the  illumination  to  be  in 
the  red^^or  infrared  spectrum  (  600-800nm  );  thus  a  uniform  light  source  at  650nm  was  used.  Segmented  images  were  acquired 
by  shifting  the  image  plane  to  simulate  the  mosaic  technique.  A  total  of  2x2  images  totaling  an  area  of  1536x1024  pixels  were 
acquired  and  used  to  test  the  overall  performance  of  the  parallel  hardware  architecture.  The  multiple  DSP  circuitry  used  is  a 
PCI  bus  based  development  board  for  a  PC  compatible  computer. 

Input/Ouiput  Capabilities 

The  maximum  CCD  acquisition  time  was  recorded  with  a  pixel  clock  of  2.5MHz  and  a  CCD  exposure  time  of  160ms.  The 
input  clock  for  the  maximum  COM  port  transfer  through  the  DMA  to  memory  was  12MH2.  The  bad  pixel  removal  algorithm 
was  written  in  C  and  not  optimized  in  assembly  for  the  C40.  Finally,  the  total  DMA  sustainable  bandwidth  for  the  C40  was 
measured  using  4  COM  ports  as  inputs  each  operating  and  8MHz  each.  The  measured  values  are  as  follows: 


Maximum  acquisition  time,  taca 

0.7s 

Max  sustainable  C40  COM  port  speed  using  DMA  transfer 

12MB/S 

Dead  pixel  removal  time  ( DSP  calculated  ),  t^ad 

0.9s 

Total  DMA  sustainable  bandwidth  per  C40 

32MB/S 

Table  3:  I/O  Capabilities  and  dead  pixel  removal  execution  time 


Intensity  Correction  For  Optical  Non-unifortn  Illumination  of  CCD 

As  with  most  optical  lens  systems,  the  intensity  of  the  focused  image  is  not  uniform  due  to  less  light  acquired  near  the  edges 
of  the  lens.  This  non-uniformity  is  considered  a  low  frequency  noise  component  and  considerably  alters  the  RMS  noise  value 
of  the  imager.  A  correction  routine  must  be  applied  to  remove  this  noise  component  from  the  system.  The  following 
calculations  show  the  method  devised  for  this  system: 


X  = 


n-mt^M 


xiij)  =  X{i,j)-Y,{ij) 
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The  image,  Xc ,  used  to  find  the  correction  coefficients  is  an  average  of  100  acquired  images  of  the  same  unifonn  intensity 
field.  Once  the  coefficients,  Y^,  are  calculated,  they  are  stored  in  the  system  for  future  application.  Each  image  that  is 
individually  acquired  is  corrected  for  non-uniform  intensity  with  these  coefficients.  The  total  DSP  computation  time  for  the 
application  of  the  coirection  coefficients  on  a  single  image  was  measured  as: 

=0.125 


Distortion  Correction  of  Optical  Aberrations 

Figure  9  below  shows  4  breast  images^  taken  with  the  imager  each  768x512  pixels: 


Figure  9:  Four  Images  Acquired  With  Single  CCD  -  Film  Was  Repositioned  To  Simulate  Mosaic 


^  The  original  mammograms  were  taken  using  conventional  film  and  these  films  were  imaged  with  the  CCD  imager  to 
simulate  the  acquisition  of  actual  mammograms. 


Note  the  overlapped  areas,  these  are  required  to  precisely  register  the  final  image.  After  applying  the  distortion  correction 
routine,  the  following  4  corrected  images  were  obtained.  The  total  processing  time  required  for  this  correction  step  on  one 


Figure  10:  Four  images  after  lens  distortion  correction 


Total  Acquisition  and  Registration  Time  For  2x2  CCD  Module 

The  following  calculation  presents  the  imager's  acquisition-to-registration  time.  Note  that  the  factors  of  4  correspond  to 
computations  repeated  on  each  of  the  4  CCD  images. 

?mod«0.7  +  4(0.9  +  0.12  +  2) 

^mod  ®  ^ 

Where  t,,,,^  is  the  total  image  acquisition  and  registration  time  for  4  CCD  images  using  one  C40  DSP;  the  total  image  size  after 
reconstruction  is  1410x956  pixels.  The  fully  registered  image  is  shown  below: 


Figure  11:  Fully  reconstructed  image  from  four  segments,  1410x956  pixels 


DSP  Intercommunication  Speed 


The  following  table  reports  the  data  transfer  speed  between  two  C40  DSP’s  via  one  intercommunication  port: 


1  Data  Transfer:  1  CCD  Image 

Elapsed  Time  For  Data  Transfer, 

Average  Bandwidth  I 

800kB 

0.1258  s 

1  6.25MB/S  1 

Table  3:  DSP  Intercommunication  transfer  speed 


The  communication  speed  reported  above  gives  a  measure  of  the  bandwidth  available  for  carrying  out  the  final  registration. 
The  method  used  for  stitching  the  overall  image  across  multiple  mosaic  modules  only  requires  the  passing  of  image  data  to  a 
final  memory  located  on  a  host  workstation.  Below  shows  the  image  transfer  scheme  for  the  full  size  imager: 


Figure  12:  Final  Image  Readout  To  Master  DSP  on  Host  Workstation 


A  total  of  9  transfer  steps  are  required  to  collect  all  the  image  data  to  the  workstation.  The  overall  estimated  time  from 
acquisition-to-display  for  the  mammography  device  is  calculated  as: 

«  36  x0.1258j+ 12.8s 


5.  CONCLUSIONS 

A  complete  parallel  hardware  architecture  for  CCD-mosaic  digital  mammography  was  presented.  The  three  layer  method  for 
designing  the  mosaic  hardware  allows  various  configurations  of  CCD's,  analog  processors,  and  digital  processing  elements  to 
maxTmize  efficiency  for  the  development  of  digital  mammography  systems.  The  architecture  presented  also  allows  various 
image  registration  techniques  to  be  implemented  using  high  level  programming  languages.  The  particular  registration  method 
used  shows  very  promising  results  in  terms  of  accuracy  and  the  speed  in  which  each  routine  is  executed  on  the  hardware.  The 
total  time  is  approximately  17  seconds  for  full  registration  of  the  final  mammogram  and  requires  only  one  exposure.  These 
results  are  very  promising  specifically  for  the  following  aspects: 

■  Close  to  real-time  preliminary  inspection  of  the  mammograms  by  physicians 

■  Accelerated  telemammography  due  to  digital  image  availability 

■  Accelerated  image  archiving 

■  Parallel  DSP  processing  availability  to  perform  detection  algorithms,  loss-less  compression,  or  other  computationally 
intensive  image  processing  tasks  directly  following  acquisition 
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1.  Introduction 

Mosaic  architecture  based  digital  mammography  is  attractive  since  it  offers  an  affordable 
and  scaleable  solution  towards  obtaining  high  resolution  digital  mammograms.  Limitations 
on  the  clinical  usability  of  the  architecture  can  be  associated  to  the  x-ray  conversion 
screen  utilized  and  to  the  methods  employed  to  reconstruct  the  final  digital  mammogram. 
The  x-ray  conversion  screen  imposes  limits  on  the  efficiency  of  the  optical  conversion  and 
the  resolution  of  the  finest  resolvable  detail.  This  can  be  addressed  to  an  extent  via  use  of 
specialized  materials  [1].  Reconstruction  techniques  on  the  other  hand  are  likely  to 
introduce  artifacts  in  the  final  image.  This  can  be  addressed  by  employing  complex 
reconstruction  algorithms,  which  consequently  may  increase  the  time  required  to  generate 

the  final  image.  .  ,  •  tu 

The  following  section  presents  an  overview  of  the  mosaic  architecture.  Ihe 

primary  objective  of  this  paper  is  to  illustrate  the  applicability  of  the  mosaic  imaging 
architecture  to  generate  digital  mammograms.  In  section  3  a  simulation  study  used  to 
evaluate  the  effect  of  technique  on  the  quality  of  the  reconstructed  image  is  described. 
Section  4  contains  the  results  of  the  simulation  study.  Finally  some  discussions  and  future 
areas  of  work  are  identified  in  section  5. 


2.  Parallel  architecture 


The  imaging  hardware  methodology  developed  for  this  device  is  based  on  a  two- 
dimensional  array  of  charge-coupled  devices  (CCD’s)  and  lenses  to  acquire  Imge  format 
mammograms  as  shown  in  figure  1  below  [2].  The  analog  and  digital  electronics  required 
to  process  this  parallel  array  of  CCD's  is  based  on  a  three  layer  approach  shown  in  figure 
2.  By  effectively  separating  the  CCD's,  the  analog  processors  (AP's),  and  the  digital 
processors  (  PE's  ),  the  parallel  architecture  may  be  optimized  for  performance,  cost,  and 
size. 


Figure  1  :  CCD  mosaic  array 


Figure  2  :  Three  layer  modular  mosaic  electronics 
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Figure  3  :  Analog  processor  for  each  CCD 
channel 


Figure  4  :  Parallel  processing  array  and  image  readout 
sequence 


The  CCD  chosen  for  this  digital  mammography  device  is  the  Kodak  KAF-0400  768x512 
pixel  image  sensor.  A  total  of  72  CCD's  are  used  in  a  8x9  array  for  the  fiill  digital 
mammography  device  which  forms  a  maximum  image  size  of  6144x4608  pixels.  The 
analog  processing  electronics  consist  of  an  array  of  correlated  double  samplers  (CDS  s) 
and  12  bit  A/D  converters.  The  CDS  circuit  effectively  removes  pixel  reset  noise  from  the 
CCD's  analog  signal  and  is  of  integral  importance  in  the  analog  processing  chain  (figure 
3).  The  overall  pixel  rate  of  the  mosaic  imager  is  2.5MHz. 

The  digital  processing  array  consists  of  18  TMS320C40  DSP  processors  in  a 
ladder  configuration  as  shown  in  figure  4  above.  Each  DSP  module  acquires  4  CCD 
images  and  performs  reconstruction  to  foiin  a  4x1  segment  image.  The  control  points 
derived  from  a  calibration  procedure  set  the  stitching  points  for  each  of  the  image 
segments.  Thus,  each  image  segment  is  directly  read  out  through  a  master  DSP  to  a  main 
memory  to  form  the  final  mammogram. 

The  total  acquisition-to-display  time  was  determined  by  measuring  the  total  time 
required  for  the  4x1  mosaic  module  in  combination  with  the  overall  readout  time  from  the 
parallel  DSP  architecture.  A  single  4x1  segment  module  required  12.8  sec.  to  acquire  and 
process.  The  average  transfer  speed  between  DSP's  is  6.25MB/s  and  a  total  of  36  transfer 
steps  are  required  to  collect  all  the  image  data  to  the  workstation.  Thus,  the  overall 
estimated  time  from  acquisition-to-display  for  the  mammography  device  is  estimated  to  be 
approximately  18  sec. 

This  complete  parallel  hardware  architecture  for  CCD-mosaic  digital 
mammography  shows  promising  results  in  terms  of  the  following; 

•  Close  to  real-time  preliminary  inspection  of  the  mammograms  by  physicians 


•  Accelerated  telemammography  due  to  digital  image  availability 

•  Accelerated  image  archiving 

•  Parallel  DSP  processing  availability  to  perform  detection  algorithms,  loss-less 
compression,  or  other  computationally  intensive  image  processing  tasks  directly 
following  acquisition 


3.  Quality  of  the  reconstruction. 

The  quality  of  reconstructed  images  can  be  subjectively  evaluated  by  expert  observers. 
However,  in  order  to  numerically  quantify  the  quality  of  the  image,  an  expected  ideal 
image  is  required.  In  this  study,  an  original  mammogram  was  segmented  into  several 
overlapping  sub-images  to  simulate  image  acquisition  by  several  CCDs.  Subsequently  a 
distortion  function,  similar  to  that  introduced  by  the  imager  optics,  is  applied  to  each  tile. 
The  mosaic  image  is  reconstructed  by  stitching  all  the  sub-images  together.  Details  of  the 
reconstruction  techniques  used  in  this  study  can  be  found  in  earlier  publications  [3].  Note 
that  if  a  given  set  of  distorted  sub-images  are  generated,  the  remaining  stages  in  the 
reconstruction  are  just  as  they  would  be  for  any  image  acquired  directly  through  the 
CCDs.  The  reconstructed  and  original  mammograms  may  be  compared  using  similarity 
measures.  Computing  similarity  measures  on  entire  mammograms  can  provide  a  global 
estimate  of  the  image  reconstruction  quality.  However,  in  mammography  local  features 
such  as  microcalcifications  or  masses  are  of  major  relevance.  Therefore  in  this  simulation 
study  the  emphasis  is  given  on  the  fidelity  with  which  such  features  can  be  reconstructed. 
By  doing  so,  the  types  of  artifacts  introduced  by  the  reconstruction  techniques  can  also  be 
better  observed. 


4.  Experimental  results 

A  set  of  mammograms  were  selected  from  the  publicly  available  MIAS  database  [4].  Each 
image  was  of  size  1024  x  1024  pixels,  sampled  at  200  micrometer  pixel  size  resolution. 
Consultation  with  expert  radiologists  prompted  the  selection  of  images  with  the  types  of 
features  within  a  circular  area  of  radius  (in  pixels)  as  follows: 

•  Circumscribed  Mass  -  29  pixels 

•  Spiculated  Mass  -  53  pixels 

•  Microcalcification  -  8  pixels 

The  most  severe  distortions  or  artifacts  can  be  expected  in  the  region  where  four  (4) 
neighboring  CCDs  observe  the  same  overlapping  area.  In  order  to  study  the  artifacts 
introduced  in  this  region  the  features  of  interest  in  the  original  mammogram  were  located 
within  the  overlap  region  of  four  sub-images.  The  original  mammogram  was  cropped  into 
four  sub-images  and  a  distortion  function  was  applied  to  each  of  the  cropped  regions. 
These  four  images  were  then  supplied  to  the  mosaic  imager.  Distortion  correction 
schemes  using  Piece-wise  linear  approximation  (PL),  Bilinear  interpolation  (Bl)  and 


Spline  interpolation  (SP)  were  applied  to  correct  each  cropped  image.  Sections  from  the 
corrected  sub-images  that  do  not  belong  to  the  overlap  area  of  the  four  CCDs  were 
extracted  and  placed  together  to  form  the  reconstructed  image. 

Mean  squared  error,  mean  absolute  error  and  cross  correlation  were  the  similarity 
measures  employed  in  this  work[5].  In  Table  I  the  results  of  comparing  the  original  image 
and  the  reconsti  ucted  image  are  shown.  It  should  be  noted  that  overall  the  Spline  based 
reconstruction  provided  the  better  result. 


MAE  MSE 

Feature  PL  B1  SP  PL  BI  SP 

Circum.  Mass  1.48  1.08  1.16  4.70  2.58  2.97 

Spic.  Mass  1.44  1.09  1.55  3.96  2.ol  2.66 

Microcal. _ 1.36  1.19  1.97  j.79  2.99  8.85 


CC 


PL 

BI 

SP 

0.99 

0.99 

0.99 

0.99 

0.99 

0.99 

0.99 

0.99 

0.98 

Table  L  Quantitative  results  computed  on  regions  with  features  of  interest. 

Visual  assessment  of  the  images  was  carried  out  by  presenting  the  reconstructed  images  to 
expert  radiologists.  There  were  no  significant  differences  observed  by  the  radiologists. 
However,  when  observing  the  features  in  the  unsharp  mask  enhanced  images,  the  piece- 
wise  linear  reconstruction  technique  provided  the  most  accurate  visual  results.  The  images 
in  Figure  4.1  below  show  two  of  the  features  investigated  as  they  appear  in  the  unsharp 
mask  enhanced  images  [6]. 


Figure  5:  Images  of  the  areas  with  features  of  interest.  Left-right:  Original,  piece-wise  linear,  bilinear, 
spline.  Top  row:  spiculated  mass.  Bottom  Row:  Microcalcification. 


5.  Discussion 

The  architecture  presented  in  this  work  is  a  generalized  solution  towards  mosaic  irnaging 
and  promising  results  in  terms  of  affordability  and  scalability.  During  evaluation  it  was 


observed  that  spline  based  reconstruction  was  the  most  complex  and  time  consuming 
technique.  Nevertheless,  even  for  this  technique  full  reconstruction  was  achieved  in  under 
1  minute.  The  scaleable  nature  of  the  architecture  guarantees  that  even  if  several  CCDs  are 
used  in  the  mosaic  imager,  the  reconstruction  time  will  not  be  significantly  affected. 
Visual  assessment  and  numerical  quantification  resulted  in  significantly  distinct  findings. 
Numerical  quantification  provides  a  statistical  mechanism  to  choose  the  better  technique. 
Meanwhile  the  visual  assessment  is  a  subjective  task  and  can  vary  from  case  to  case.  A 
good  compromise  between  the  two  extremes  can  be  obtained  by  usmg  the  bihnear 
reconstruction  approach.  Clinical  usability  of  this  approach  will  be  dependent  on  the  X-ray 
conversion  screen  employed.  Further  work  needs  to  be  done  to  investigate  the  effect  of  the 
X-ray  conversion  screen.  Additional  work  is  also  needed  to  improve  the  stitching  and 
reconstruction  techniques. 


6.  References 

1  J.  A.  Rowlands,  D.  M.  Hunter  and  N.  Araj,  “X-Ray  Imaging  Using  Amorphous  Selenium:  A  photomduced 
discharge  readout  method  for  digital  mammography”,  Med.  Ph^  Vol.  1 8,  pp.  42M3 1, 1991. 

2  Scott  T.  Smith,  Hyunkeun  Kim,  Vivek  Swarnakar,  Myoungki  Jcong  and  Darold  C.  Wobschall,  Parallel 
hardware  architecture  for  CCD-mosaic  digital  mammography”,  SPIE  Medical  Imaging  -  98. 

3  V  Swarnakar,  M.  Jeong,  S,  Smith,  H.  Kim  and  D.  Wobshall,  “An  Integrated  Distortion  Correction 
Reconstruction  Technique  For  Digital  Mosaic  Mammography”,  SPIE  Medical  Imaging,  vol.  3031,  pp. 
673,  1997. 

4  MIAS  Database:  http://skye.icr.ac.uk/miasdb/miasdb.html 

5  R  Salvi,  “Introduction  to  Applied  Statistical  Signal  Analysis”,  IRWIN  1991 . 

6  A  K  Jain  “Fundamentals  of  Digital  Image  Processing”,  Prentice  Hall  1989. 


Imirg 


Mosaic  imaging  Research  Group 


Evaluation  of  A  Digital  Mosaic  Mami 


Vivek  Swamakar,  Scott  T.  Smith,  Myoungki  Jeong,  Hyunkeun  Kim,  Darold  Wobschall 


Objectives 


Apply  the  recoflstnjciiDi)  technique  to  different  t>pes  of 
mairtmographic  image  iIhU 
Nutr^crically  and  i  isitiiliy  evaluate  quality  of  images 
gcneiated  osittgeach  wconsuvciion  tiechnic\ue. 

HvaJuate  the  effect  each  iccliniquc  has  on  the  quality  of 
iridividoally  (cconsmicted  features  of  inlcfcsl. 
Determine  paromciris  ihat  most  inttaence  each 
technique 

Dcmcmslriiie  an  efficient  jsiniilcl  hanJwtrtrt  tirchilwiMrt 
to  accomplish  all  iiTugiiijJ,  lUtd  pnxessioji  ne«ds 


Difiital  Mosaic  Ima^in^ 

Mo«ic  imaging  requires  corTectioo  of  Hie  distortion 
introduced  by  eotfi  intlividutii  optiCill  component  luvd 
stitching  of  the  individuiaf  sub-images  to  obtain  a 
digital  mosaic  (luitmnogram  rccoiwtruclioiv. 

Digital  tiMwaic  imaging  provides  a  sculcuble.  high 
fcsokition/cosi  means  for  mammognijdiy. 

The  correction  scheme  plays  a  pivotal  roie  in  the 
quality  of  the  final  reconstructed  mammogram. 

High  accuracy  in  the  distortion  cvnrection  step  allow  s 
the  use  of  a  stmpfiiled  siilclntig  schctitc. 


Lens  Based  CCD  Mosaic  Array 


OvsnaKPns 


Advantages  of  A  Parallel  Architecture  For 
CCD  Mosaic  Digital  Mammo^aphy 


Clow  to  real-time  preliminary  iospectitvi*  of  Uw 
niummograms  by  pliysiciims 

Accelciuted  tdemannnosgiujAy  due  to  digital  image 
availability 

Accelerated  image  archiving 

Pitriillcl  DSI*  processing  iivniliibiiity  to  pcrfoiiu  detection 
algorithms.  Ioss-Icbs  conrtpiessiwi,  or  oiher 
compuuilioiwlly  intensive  image  proccisiiig  tusks  directly 
following  acqwisiihm 


Three  Layer  Hardware  Appi'oach  For 
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Single  CCD  Prototype  Imager 


This  single  channel  prototype  whs  used  to  measure  the 
feasibility  of  the  larger  CO)  mosaic  required  for  the 
complete  mamiiiograpfiy  imager, 

A  test  puitcm  was  rcposhictned  in  the  X-Y  plane  to 
emulate  a  2s2  mosaic. 
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Distortion  Correction 


‘  A  custom  dedened  ca  lihrution-sciecn  with  ndticial 
matiCTi  is  employed  to  adiieve  high  accuracy  of 
di^ortion  corwtkm, 

•  Intcr-fiducial  distance  relation  is  known  a  jwiori. 

■  Thtee  typci  of  cofirectioi)  schemes  are  investigated: 

-  Pieec-whe  Umar  (hicitl  Ofmratar) 

-  liitintur  irAcrpniafion  fgfaUu!  operatc^rf 

-  Spliw  (ghM  optTitfor) 

■  The  images  shown  below  were  cofrccicd  using  spline 
interjvlutioii  after  acquisition  fnxn  the  i-tngle  CCD 
prototype  imager 


Digitized  Calibration  Pattern 


Reconstructed  Calibration  Pattern 


Analog  Processing  For  8x9  CCD  Imager 


Parallel  Array  of  Processing  Elements 


“'*“■000000000 
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W  Jjta  la  Innfcr  vm  ■«»•»  *"  USe  fnmt. 

T  Uf»cr»9iOTai>t  ItllinMi*  wuh 

- 12^,1 


Reconstniction  Siniulatkm  Results 

•  The  images  used  ttre  secrions  of  actual  mammcigrams 
»  Tlw  distortion  introduced  is  modeled  numerically 

ttsirtg  a  “borrel  dtstottkirt**  apprOMmatiors 
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Conclusions 


Quantitative  Analysis'Vistual  Analysis 

-  Image  restoration  from  a  global  perspective  is  best  using 
tlse  Cubic  Spline  apjutKich. 

-  The  Bilinear  interpolation  provides  best  iw.uH.s  in 
quantitative  amlyt»is. 

•  When  individual  fculures  and  image  ptcicessing 
algorithmstsuch  as  unshaip  liltcfing  nud  edge 
cnlionccmeni)  arc  considered  in  visual  anaIyHis^  the 
Piece-wise  linear  appaxteh  provides,  better  results. 

Global  correction  approachcsfBilmear/SpImej  ore  less 

sensitive  to  errors  in  the  detected  fiducial  markers. 

When  considering  detailed  fcciiures  such  as 

microcalcifications,  a  localised  conection  uppioach  shixild 

beempioyc<l 

CCD  Mosaic  Hardwate  Atfliiicciure 

-  1  he  three  layer  modular  Kirdwarc  aijprtwcb  athw-cd 
evaluation  of  overall  pcrfortnjrK'Ccf  an  KsbCfM)  imager 
by  only  consiructtne  a  sinfile  CCD  biiager. 

-  The  estimulcd  acq«isiti<m-to-display  time  demunstriUe?- 
ihe  speed  at  v/hkh  nwtttnvugriims  would  S>eavaihibte  for 
mspeciion  and  processing,  ~  IK  second?. 

-  Tlw  Mttgle  CCD  imager  also  [^viited  the  platfonu  to 
sufficiently  test  the  nrcontunictkin  .wiShvar*  capitbtliticv 
with  4  actual  calibration  paitero  images 
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